I’m building Key Trustee to simplify AI integration. Key Trustee is an optimizing model router (based on RouteLLM) that provides unified “bring your own key” functionality so that users only have to enter their keys once for all their enabled applications. Key Trustee is OAuth based, so you can re-use your application’s existing auth tokens, and it uses an OpenAI compatible API so it integrates with existing AI code easily.
Key Trustee also allows you to build secure “serverless” AI applications. As long as you have a working OAuth flow, your application can be built entirely in the client!
We're planning to add a push-based payment system that integrates with Stripe, letting users approve or deny payments directly with micropayment support using API credits so you don’t need a separate in-app currency. It’s still in development, but we’ll keep you posted when it’s live.
We're also planning to support pass through inference to local LLMs, so if you have an Ollama/Llama.cpp server running you'll be able to use that with all your Key Trustee enabled applications.
My goal with Key Trustee is to make life easy for small and medium sized application developers. To that end, I’d love to hear your ideas, thoughts and feedback! My email is in my profile and I have a discord if you’d like to chat: https://discord.com/channels/1282344086430421060/12823440864...