79% of ChatGPT level
Small enough to leave running
Runs in:
Fits on:
· needs ~2 GB · Free to download · License: Llama 3.2 Community License
Smart home assistant offline
Voice commands without the cloud.
The tools below run on your computer. Most of them are free, and the local work stays on your machine.
Works offline · Free options
Your computer
Describe your computer
Pick the closest line. Office PC and Mini PC are estimates. Linux and a home server stay in the list. We guess the specs, then hide models that would not fit. The guess stays cautious.
6 results
Most tools here are free.
Writing Audio & Music Hears the command
Runs in:Fits on:· needs ~0.5 GB · Free to download · License: MIT
whisper.cpp
The small engine behind many transcription apps, including on Windows and Linux.
Installer only · Some setup · Free
Audio & Music Not on the chat board
Speaks the reply
Runs in:Fits on:· needs ~0.1 GB · Free to download · License: GPL-3.0
HONEST COMPARISON
Local or cloud: Smart home assistant offline?
Reviewed Oct 2026
- Privacy: Local winsHome Assistant does not need a speaker company
- Cost: Local winsThe software is free
- Quality: Cloud winsA speaker understands more out of the box
- Ease: Cloud winsYou talk to it the day it arrives
Local AI
A local chat model is not a smart home. Home Assistant is the offline house.
- Home Assistant can run on a small computer you own
- A tiny local model can answer without the cloud
Where it falls short
- The chat models on this list do not switch your lights
- Voice control still needs a real assistant app
Cloud & apps
Alexa, Google Home and Apple Home are easier, and the speaker is listening.
- AAlexaHardwareFreemium
The easiest voice in the room, on Amazon's cloud.
Best for: VoiceSpeakers
Requests go to Amazon
- GGoogle HomeHardwareFreemium
Voice and routines if your house is already on Google.
Best for: Routines
Requests go to Google
- HHome AssistantHome hubFreePopular choice
The real offline home: local control, and voice if you add it.
Best for: Offline homeLocal control
It runs on hardware you control
Our take
For an offline house, use Home Assistant. A cloud speaker is easier, and it listens in the room.
Choose local if…
- You want the house offline
- You will set up a hub
Choose cloud if…
- You want to talk to a speaker today
- You already bought the speakers
How to do it in 3 steps
- Open the model page and pick any app under Runs in, for example AnythingLLM, GPT4All or Jan. Each app page links to that maker's own guide.
- Open the Llama 3.2 3B page and check the traffic light for a few kinds of computer.
- Follow that official guide. This site does not add its own install steps.
Questions
- Does this upload my files?
- The local tools on this page don't upload your files. The cloud options in the comparison do.
- What does it cost?
- Most options are free. A few apps are a one-time purchase, and a few models need a computer with more memory.
- What if it will not fit?
- Use Check my computer, or turn on the lighter memory filters. A red light on the model page means the file is too big.
Not into local AI? Try these instead
Ordinary apps for home & garden. These are normal links to the maker's site.