Local AI
Download a model and run it through a compatible app such as Ollama or LM Studio.
- You choose the model and control its files.
- Your available memory limits what fits.
- You handle setup, updates and power use.
CHOOSE HOW YOUR AI RUNS
The important difference is where the model does its work. Your choice changes the hardware you need, the setup you manage and where your prompts are processed.
Download a model and run it through a compatible app such as Ollama or LM Studio.
Use an assistant or an API. The provider runs the model on its infrastructure.
Rent a remote machine and run your chosen model there. You still manage the software.
| Consideration | Local model | Hosted assistant | Rented GPU |
|---|---|---|---|
| Who manages the model? | You | The provider | Usually you |
| Local AI GPU needed? | Usually, for full GPU inference | No | No |
| Where do prompts run? | On your machine, if configured locally | On provider infrastructure | On a remote server |
| Typical cost components | Hardware, electricity, maintenance | Subscription or metered usage | Rental, storage, transfer |
| Offline use? | Possible after setup; check app features | Generally requires a connection | Requires a connection |
If ChatGPT is the comparison you actually care about, we have a focused guide covering convenience, privacy boundary, hardware, cost and offline use.
Compare local AI with ChatGPT →A product name, model family and desktop app are not always the same thing.
Use the service without downloading its model weights. OpenAI gpt-oss is a separate downloadable family, not a local copy of ChatGPT.
OpenAI open-weight model guide ↗Claude is accessed through its app, API or supported cloud platforms. The hosted models are not downloadable weights in this calculator.
Anthropic model documentation ↗Gemini apps and APIs use Google-hosted models. For downloadable Google models, explore Gemma, a separate family with different capabilities.
Google model documentation ↗A coding tool running on your computer does not necessarily run its AI model there. For a supported local-model setup, calculate the underlying model’s memory.
OpenAI gpt-oss and local setup ↗Check the whole workflow. A local app can still use web search, remote tools or cloud APIs. Keeping a model on your computer does not automatically make every feature offline.
Understand the local privacy boundary →Gemma and gpt-oss are downloadable options, but are not equivalent copies of Gemini or ChatGPT. Test the tasks you actually need and check each model’s licence.
Explore model requirements →Our catalogue includes 1B, 4B, 12B and 27B variants. Estimates cover text inference. Larger variants can handle images, but image processing needs additional resources.
Explore Gemma 3 requirements →The 20B and 120B variants use a mixture of experts. All expert weights still need memory for full GPU loading; active parameters alone do not describe the memory requirement.
Explore gpt-oss requirements →