Chat & Ask Docs generation models
The model that writes answers — for everyday Chat or grounded Ask Docs Q&A. Most come in both GGUF (via llama.cpp) and MLX (Apple Silicon) formats; a few sizes come in only one. Tap a size to see it on Hugging Face.
Qwen3
Alibaba's latest general-purpose family, including a mixture-of-experts variant.
Qwen2.5 Coder
Code-specialized variants for programming questions and drafting.
DeepSeek-R1-Distill-Qwen
Reasoning-distilled models for step-by-step, chain-of-thought style answers.
Vision-capable generation models
Attach an image in Chat and these models can reason over it alongside your text — most in both GGUF and MLX, a few in only one format.
Qwen3-VL
Qwen's newest vision-language family, including a mixture-of-experts variant.
Ornith & SmolVLM
A mixture-of-experts vision model and a lightweight vision model for compact devices.
Embedding & reranking models
Embedding models index your documents for hybrid search; an optional reranker re-scores the top matches before they reach the generation model.
BGE
BAAI's general embedding family, plus a matching cross-encoder reranker.
Nomic Embed Text
Long-context text embeddings, including a mixture-of-experts variant.
The Model Manager shows device-aware recommendations — memory needed, estimated tokens/sec on your chip, and an Optimal / Slower / Incompatible rating — before you download anything. Rerankers run via GGUF only; there's no MLX rerank runtime. MLX models need Apple Silicon, so Intel Macs are offered GGUF models only.
Not in the catalog? Bring your own.
The built-in catalogs cover most use cases, but Kynora AI doesn't lock you into them.
Import local weights
Already have a GGUF or MLX model downloaded? Import it directly in Model Manager — Kynora AI reads its config.json and folder layout to add it alongside the curated catalog, with the same device-fit and speed estimates.
Not every model out there has been tested against Kynora AI, so we can't guarantee an arbitrary import will run without crashing — if you hit an issue with a specific model, reach out and we'll take a look.
Connect a local Ollama server
On a Mac, advanced users can point Chat or Ask Docs at a local Ollama server instead of the built-in models (default http://localhost:11434). It's off by default. If you turn it on, conversation text, including any document excerpts Ask Docs retrieves, is sent to that server. Embedding and reranking always stay on-device. See how Kynora AI compares with Ollama and LM Studio.
Every download — catalog or your own — goes directly from the model's host (Hugging Face) straight to your device. Kynora AI doesn't sit in the middle of that connection or see the contents of what you download.
Model licenses at a glance
Licenses are as published by each model's provider and may change — always check the model's own license page before commercial or redistribution use. Meta's Llama license and Google's Gemma license both include usage restrictions beyond standard permissive licenses like Apache 2.0 or MIT; they are not OSI-approved open-source licenses.