SmolChat
A local LLM chat app runs GGUF models on Android through llama.cpp, with saved conversations and separate tasks that don't retain messages.
SmolChat is an Android app for chatting with language models on your phone. It gives people who want on-device AI a chat interface for their own GGUF model files, including small language models.
- Model choice: Add or remove GGUF models and change their system prompts and response settings for different uses.
- Saved conversations: Retains chat messages and uses them as context when you return to a conversation.
- Separate tasks: Generates responses for individual tasks without saving their messages in chat history.
- Formatted answers: Displays Markdown and highlights code syntax in model responses.
Model inference runs on the Android device through llama.cpp. SmolChat is open source under the Apache 2.0 license and is available through Google Play or as an APK from the project's releases.
Logotyper
