A generalized information-seeking agent system with Large Language Models (LLMs).
-
Updated
Jun 19, 2024 - Python
#
localllm
Here are 90 public repositories matching this topic...
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
natural-language-processing text-generation transformer llama quantization model-compression efficient-inference post-training-quantization large-language-models llm small-models localllm
-
Updated
Aug 13, 2024 - Python
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
natural-language-processing compression text-generation transformer llama quantization mistral model-compression efficient-inference efficient-model large-language-models llm small-models localllm localllama
-
Updated
Aug 13, 2024 - Python
The PyVisionAI Official Repo
python open-source ocr computer vision openai llama vlm vision-models localllm ollama claude-3-5-sonnet
-
Updated
Jul 19, 2025 - Python
Fenix Ai Trading Bot with LangGraph and ollama and multipe providers
-
Updated
Apr 8, 2026 - Python
A Cli, a webUI, and a MCP server for the Z-Image-Turbo text-to-image generation model (Tongyi-MAI/Z-Image-Turbo base model as well as quantized models)
python apple ai cuda webui lora mps text-to-image rocm text2image apple-silicon diffusers localllm mcp-server z-image-turbo z-image
-
Updated
Apr 15, 2026 - Python
MVP of an idea using multiple local LLM models to simulate and play D&D
dnd local multiagent streamlit llm localllm local-ai ollama multi-llm llm-generator ollama-python multi-ai llm-game ai-dnd
-
Updated
Apr 23, 2025 - Python
GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).
machine-learning vulkan python-wrapper fastai amd-gpu intel-gpu llama-cpp gpu-inference llm-inference localllm local-ai open-source-llm llama-cpp-python gguf legacy-gpus
-
Updated
Oct 14, 2025 - Python
BMO - Local Ai companion
python raspberry-pi ai multi-agent-systems adventure-time bmo local-companion llm local-llm localllm multi-llm
-
Updated
Feb 26, 2026 - Python
A local chatbot for managing docs
-
Updated
Jun 14, 2025 - Python
Open WebUI Tools for Google Services: Manage contacts, send emails, and schedule Google Meet meetings directly from your AI assistant using Google APIs.
-
Updated
Apr 25, 2025 - Python
Demo project showcasing Gemma3 function calling capabilities using Ollama. Enables automatic web searches via Serper.dev for up-to-date information and features an interactive Gradio chat interface.
machine-learning googleapi artificial-intelligence llm genai localllm function-calling ollama gemma3
-
Updated
Mar 30, 2025 - Python
An automated pipeline to convert e-books into beautifully illustrated scenes using local AI backends ComfyUI and SD Forge.
-
Updated
Jan 9, 2026 - Python
Improve this page
Add a description, image, and links to the localllm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the localllm topic, visit your repo's landing page and select "manage topics."