Skip to content

A curated guide to running Large Language Models (LLMs) on your own machine. Covers tools like Ollama, LM Studio, LocalAI, GPT4All, and more!

Notifications You must be signed in to change notification settings

LiteObject/Local-AI

Repository files navigation

Run AI Models on Your Computer

Stop paying for ChatGPT! Run powerful AI models directly on your computer for free, with complete privacy.

Why Run AI Locally?

  • Free - No monthly subscriptions
  • Private - Your data never leaves your computer
  • Always Available - Works without internet
  • Customizable - Train models for your specific needs

Step 1: Choose Your Tool

For Complete Beginners

LM Studio - Point and click interface

  1. Download and install
  2. Browse models in the app
  3. Click download, then chat

For Command Line Users

Ollama - Simple commands

# Install (Mac/Linux)
curl -fsSL https://ollama.com/install.sh | sh

# Windows: Download from website

# Run your first AI model
ollama run llama3.2:3b

Step 2: Check Your Hardware

Your Computer Has You Can Run Quality
8GB RAM, no gaming GPU 7B models Good for most tasks
Gaming GPU (8GB+) 13B models Very good
High-end GPU (16GB+) 30B+ models Excellent

Don't know your specs?

  • Windows: Right-click "This PC" → Properties
  • Mac: Apple Menu → About This Mac

Step 3: Pick Your First Model

Start with these beginner-friendly models:

  • llama3.2:3b - Best all-around model (current recommendation)
  • phi3.5:3.8b - Fast and efficient
  • qwen2.5:7b - Excellent multilingual model
  • qwen2.5-coder:7b - Best for programming help

📋 See detailed model guide → 🆕 Current model recommendations →

Step 4: Start Chatting

In LM Studio

  1. Download a model from the search tab
  2. Go to chat tab
  3. Select your model and start typing

In Ollama

ollama run llama3.1:8b
>>> Hello! How can I help you today?

Troubleshooting

Model runs slowly? Try a smaller model like phi3:mini Out of memory errors? Your computer needs more RAM/VRAM Can't install? Restart your computer and check antivirus settings

Learn More

Need Help?

  • Most issues are solved by trying a smaller model
  • Check if your antivirus is blocking the installation
  • Restart your computer after installation

About

A curated guide to running Large Language Models (LLMs) on your own machine. Covers tools like Ollama, LM Studio, LocalAI, GPT4All, and more!

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published