Ollama
The simplest app for a local chatbot. Pick a model, then talk.
Installer only · One-click app · Free
Chat with an AI privately
A ChatGPT-like assistant that never leaves your computer.
The tools below run on your computer. Most of them are free, and the local work stays on your machine.
Works offline · Free options
Your computer
Describe your computer
Pick the closest line. Office PC and Mini PC are estimates. Linux and a home server stay in the list. We guess the specs, then hide models that would not fit. The guess stays cautious.
5 results
Most tools here are free.
Work & Office A step behind Gemma 3 12B, and a clear step ahead of a 3B toy model.
The everyday private chatbot
Runs in:Fits on:· needs ~5.2 GB · Free to download · License: Apache 2.0
Writing 97% of ChatGPT level
A newer private chat model, about 18 GB
Runs in:Fits on:· needs ~18 GB · Free to download · License: Apache 2.0
- Work & Office
Hermes 3 8B
Fine-tune of Llama 3.1 8BA fine-tune, not a new architecture. It sits with other 8B chat models, and it is not given a separate ChatGPT percentage here.
A Llama 3.1 fine-tune, about 5 GB
Runs in:Fits on:· needs ~4.7 GB · Free to download · License: Llama 3.1 Community License
HONEST COMPARISON
Local or cloud: Chat with an AI privately?
Reviewed Oct 2026
- Privacy: Local winsThe conversation never leaves your PC
- Cost: Local winsEveryday chat is free
- Quality: Cloud winsThe top hosted models are still sharper
- Ease: Cloud winsOpen a tab and type
Local AI
This is the job local AI is for. The chat stays on your computer.
- No account and no transcript on a vendor's server
- Works offline
- A small model is enough for everyday chat
Where it falls short
- The best cloud models are still sharper
- You give up web search and live tools
Cloud & apps
ChatGPT and Claude are smarter and easier, and the conversation is on their servers.
- CChatGPTCloud AIFreemiumPopular choice
A sharper general chat, with tools a local model does not have.
Best for: Hard questionsTools
The chat is stored by OpenAI unless you change the settings
- CClaudeCloud AIFreemium
Careful long answers, still on Anthropic's servers.
Best for: Long answers
The chat is sent to Anthropic
Our take
If privacy is the point, run the chat locally. A cloud bot is smarter, and it is not private.
Choose local if…
- The topic is personal
- You want it offline
Choose cloud if…
- You want the sharpest answer
- You need web search or tools
How to do it in 3 steps
- Open the model page and pick any app under Runs in, for example AnythingLLM, GPT4All or Jan. Each app page links to that maker's own guide.
- Open the Qwen3 8B page and check the traffic light for a few kinds of computer.
- Follow that official guide. This site does not add its own install steps.
Questions
- Does this upload my files?
- The local tools on this page don't upload your files. The cloud options in the comparison do.
- What does it cost?
- Most options are free. A few apps are a one-time purchase, and a few models need a computer with more memory.
- What if it will not fit?
- Use Check my computer, or turn on the lighter memory filters. A red light on the model page means the file is too big.
Not into local AI? Try these instead
Ordinary apps for work & office. These are normal links to the maker's site.
Microsoft 365
Documents, spreadsheets, and mail for everyday office work.
Microsoft 365LibreOffice
A free office suite for documents, sheets, and slides.
LibreOfficeStandard Notes
A private notes app with plain text and a paid extended version.
Standard Notes