samzong 在 【首发】开了一个新坑:搞了一个大模型聚合网关的 WebUI 中发帖
首先的确已经有非常非常多的轮子了,我自己一直在用的 one-api 给大家推荐。
背景是发现有一个 GitHub - labring/aiproxy: AI Proxy is a high-performance AI gateway using OpenAI's protocol as the entry point. It features intelligent error handling, multi-channel management, and comprehensive monitoring. With support for multiple models, rate limiting, and multi-tenant isolation, it provides a robust solution for AI service management. 的项目,看了下...