Series / AI at Home
Local and privateAI at Home
Models that run on your computer or your phone. With a local model they work without internet and your data does not leave the machine; privacy depends on the tool and on not connecting it to a remote provider.
Can I use AI on my own computer without sending my data to anyone?
That is the question this series answers. Each video comes with a fact sheet: what it is, the key fact, how to start and my verdict. How the fact sheet works.
Before you start.
Who it is for
For anyone who wants to use AI models without internet and without sending their data to anyone.
What to check
Look at how much memory and what graphics card each model needs, and its license: it is almost never the same as the program that runs it. Confirm the tool uses a local model and not a remote provider: several allow both. See the full checklist.
The 16 repos that have already appeared in this series.
3 of 16 already have their own guide (“Guide” label): license, requirements, installation and warnings. The rest open their project on GitHub. The license label comes from GitHub and each repo’s LICENSE file; each repo’s warning is still in its video (in Spanish).
-
KoboldCpp
Run local language models with a single executable.
GitHub ↗
(opens GitHub in a new tab)
License: AGPL-3.0
-
GPT4All
Chat with models that run on your computer.
GitHub ↗
(opens GitHub in a new tab)
License: MIT
-
AnythingLLM
Ask your documents questions with a local or cloud model.
Guide
(opens the guide)
License: MIT Official project (opens GitHub in a new tab) Calculator
-
Open WebUI
Chat interface for your local models.
Guide
(opens the guide)
License: Open WebUI License (BSD-3 with a branding clause) Official project (opens GitHub in a new tab) Calculator
-
Piper
Fast synthetic voice that runs without internet.
GitHub ↗
(opens GitHub in a new tab)
License: GPL-3.0
-
llamafile
A single file that runs a language model.
GitHub ↗
(opens GitHub in a new tab)
License: Apache-2.0
-
stable-diffusion.cpp
Generate images with Stable Diffusion in C++.
GitHub ↗
(opens GitHub in a new tab)
License: MIT
-
whisper.cpp
Transcribe audio without sending it to any cloud.
Guide
(opens the guide)
License: MIT Official project (opens GitHub in a new tab) Calculator
-
faster-whisper
A faster Whisper for transcription.
GitHub ↗
(opens GitHub in a new tab)
License: MIT
-
Bark
Text to speech and sounds with AI.
GitHub ↗
(opens GitHub in a new tab)
License: MIT Calculator
-
AudioCraft
Generate music and audio with AI.
GitHub ↗
(opens GitHub in a new tab)
License: MIT
-
InvokeAI
Image generator with an interface built for real work.
GitHub ↗
(opens GitHub in a new tab)
License: Apache-2.0 Calculator
-
Fooocus
AI image generation without so many settings.
GitHub ↗
(opens GitHub in a new tab)
License: GPL-3.0 Calculator
-
Krita AI Diffusion
Generate AI images inside Krita.
GitHub ↗
(opens GitHub in a new tab)
License: GPL-3.0
-
Jan
A local alternative to ChatGPT.
GitHub ↗
(opens GitHub in a new tab)
License: Apache-2.0
-
ComfyUI
Node workflows for generating AI images.
GitHub ↗
(opens GitHub in a new tab)
License: GPL-3.0 Calculator