Genkit

Genkit is Google's open-source framework for developers building AI applications and agents with local or cloud models. Its shared API connects to Ollama as well as hosted providers such as Gemini, OpenAI and Anthropic. You can host the application logic yourself. The framework uses the Apache 2.0 license.

Model choice determines where inference happens: Ollama supports local LLM use, while hosted providers process model requests through their services. Genkit's server-side code can run wherever its programming language is supported, including your own server, Firebase or Google Cloud Run. Google services are optional.

For application features, Genkit supports text and image generation, multimodal input and output, and structured data that matches declared types. Tool calling lets models use application functions, while workflows support tasks with multiple steps. It also includes prompt templates, persisted chat and retrieval-augmented generation (RAG) for answers grounded in retrieved information.

The local Developer UI gives developers a place to test prompts and workflows, compare model outputs and inspect execution traces. Tests can use individual inputs or datasets. Production monitoring tracks latency, errors, request volumes and model performance, with a dashboard in Firebase.

JavaScript/TypeScript and Go have full feature support. Client SDKs and helpers connect the server-side AI logic to web and mobile apps, including Next.js, React, Angular, iOS and Android.