Best Tools to Run LLMs Locally

Running large language models on your own machine means privacy, offline access, and no per-token bills. These are the go-to tools for local inference — from one-command runners to production serving. More on the open-source directory.

Any licenseApache-2.0MITAny languageGoPythonSelf-hostable3 tools

#ToolStarsLicenseUpdated

1

OllamaGoself-host

Run open LLMs locally with a single command.

179k18k

MIT

todayGitHub

2

vLLMPythonself-host

High-throughput open-source LLM inference engine

90k21k

Apache-2.0

todayGitHub

3

LM Studioself-host

A desktop app to discover, download, and run local LLMs.

——

—

—Details

Star counts, licenses, and activity are pulled live from the GitHub API and refreshed weekly.