Genkit

Genkit is Google's framework for developers building AI agents and chatbots into web and mobile apps. It brings model connections, application workflows and testing tools into one framework.

• Model connections: Use a shared API to work with Ollama or hosted providers including Gemini, OpenAI, Anthropic, xAI and DeepSeek.
• Agents and workflows: Let models call application functions and combine tasks into workflows with multiple steps.
• Generated content: Generate text, images and structured data that matches declared types, with support for multimodal input and output.
• Chat and retrieval: Build chat interfaces that retain conversations, reuse prompt templates and ground responses in retrieved information through retrieval-augmented generation (RAG).
• Testing and debugging: Test prompts and workflows in a local Developer UI using individual inputs or datasets, compare model responses and inspect execution traces.

You can self-host the server-side application logic or deploy it to Firebase, Google Cloud Run or another environment that supports your chosen language. Google services are optional. Hosted model providers process model requests through their services; self-hosting the application logic doesn't move those requests onto your server. Production monitoring through Firebase tracks latency, errors, request volumes and model performance.

Genkit is open source under Apache 2.0. JavaScript/TypeScript and Go have full feature support. Client SDKs and helpers connect the server-side logic to Next.js, React, Angular, iOS and Android.