People / Topics / Local LLMs and inference
Topic map · 2026-10-18
Who to follow in Local LLMs and inference
Running models: local LLMs, serving, quantization and API gateways. 79 people and 79 labs placed here by the topic tags on their own repos (or a Jev read of their repos when they use no tags), ranked by stars across their repos, shipping and influence.
People7979 labs and companies
Stars, 7 days+36.6k+130k in 30 days
Links inside29follows, mentions, pull requests
Top Influence94rUv
Rising this week+4.0kAbdur Rahim
Who pays attention to whom in Local LLMs and inference See it on the full map
Bridges to other topics
Accounts here with the most links into other topics.
Simon Willison11 links to Models and research, Coding agents, Browser and automation, RAG and memory, MCP servers, Developer tools, AI agents
Mert Cobanov9 links to Developer tools, Coding agents, Browser and automation, AI agents, Image and video, Models and research
Zhangchi Feng8 links to AI agents, Models and research, Coding agents, Developer tools, Learning and lists, Computer vision
Neko13 links to Coding agents, Developer tools, Image and video, Models and research, AI agents
Carlos Galarza11 links to Developer tools, AI agents, RAG and memory, Self-hosted apps, Models and research
Bruce MacDonald10 links to Coding agents, Models and research, Developer tools, AI agents, Learning and lists
Yaowei Zheng10 links to Coding agents, Models and research, Image and video, AI agents, Developer tools
Danny Avila9 links to Coding agents, Self-hosted apps, Developer tools, MCP servers, RAG and memory
Ettore Di Giacinto6 links to Models and research, Learning and lists, Developer tools, Coding agents, Voice and audio
yihong13 links to Coding agents, Developer tools, Models and research, AI agents
rUv9 links to AI agents, Developer tools, Coding agents, Learning and lists
Mike Pfaffenberger7 links to Developer tools, AI agents, Learning and lists, Models and researchRepos driving it this week
Measured repos of these accounts tagged with this topic, by stars in the last 7 days.
ARahim3/DigUpSearch your computer by what's in your files: photos, PDFs, documents, recordings, videos and code. On-device on Mac, W…+3.8k
lyogavin/airllmAirLLM 2.8T LLM inference with single 4GB GPU+3.0k
open-webui/open-webuiUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)+1.9k
Tencent/WeKnoraOpen-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-…+1.4k
ollama/ollamaGet up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.+1.1k
datawhalechina/hello-agents📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程+1.1k
MakazhanAlpamys/SoupFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.+783
mnfst/awesome-free-llm-apisList of Permanent Free LLM API (API Keys)+773
unclecode/crawl4aiOpen-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself…+577
mw00/project-mayaProject Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or…+574Other topics
AI agents191 people · 212 labs
Coding agents141 people · 76 labs
MCP servers55 people · 34 labs
Models and research108 people · 114 labs
RAG and memory48 people · 56 labs
Image and video54 people · 24 labs
Voice and audio39 people · 31 labs
Browser and automation41 people · 39 labs
Computer vision31 people · 46 labs
Developer tools275 people · 188 labs
Self-hosted apps134 people · 66 labs
Learning and lists60 people · 25 labs
Coding agents141 people · 76 labs
MCP servers55 people · 34 labs
Models and research108 people · 114 labs
RAG and memory48 people · 56 labs
Image and video54 people · 24 labs
Voice and audio39 people · 31 labs
Browser and automation41 people · 39 labs
Computer vision31 people · 46 labs
Developer tools275 people · 188 labs
Self-hosted apps134 people · 66 labs
Learning and lists60 people · 25 labs