A generalized information-seeking agent system with Large Language Models (LLMs).
-
Updated
Jun 19, 2024 - Python
#
localllm
Here are 63 public repositories matching this topic...
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
natural-language-processing text-generation transformer llama quantization model-compression efficient-inference post-training-quantization large-language-models llm small-models localllm
-
Updated
Aug 13, 2024 - Python
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
natural-language-processing compression text-generation transformer llama quantization mistral model-compression efficient-inference efficient-model large-language-models llm small-models localllm localllama
-
Updated
Aug 13, 2024 - Python
The PyVisionAI Official Repo
python open-source ocr computer vision openai llama vlm vision-models localllm ollama claude-3-5-sonnet
-
Updated
Jul 19, 2025 - Python
MVP of an idea using multiple local LLM models to simulate and play D&D
dnd local multiagent streamlit llm localllm local-ai ollama multi-llm llm-generator ollama-python multi-ai llm-game ai-dnd
-
Updated
Apr 23, 2025 - Python
Fenix Ai Trading Bot with crew ai and ollama
-
Updated
Jul 21, 2025 - Python
A local chatbot for managing docs
-
Updated
Jun 14, 2025 - Python
GPU-accelerated LLaMA inference wrapper for legacy Vulkan-capable systems a Pythonic way to run AI with knowledge (Ilm) on fire (Vulkan).
machine-learning vulkan python-wrapper fastai amd-gpu intel-gpu llama-cpp llm-inference localllm open-source-llm llama-cpp-python gguf legacy-gpus
-
Updated
Aug 12, 2025 - Python
Demo project showcasing Gemma3 function calling capabilities using Ollama. Enables automatic web searches via Serper.dev for up-to-date information and features an interactive Gradio chat interface.
machine-learning googleapi artificial-intelligence llm genai localllm function-calling ollama gemma3
-
Updated
Mar 30, 2025 - Python
Open WebUI Tools for Google Services: Manage contacts, send emails, and schedule Google Meet meetings directly from your AI assistant using Google APIs.
-
Updated
Apr 25, 2025 - Python
Open WebUI Tool Template & Skeleton: A starting point and guide for developing custom tools to extend your AI assistant's capabilities in Open WebUI. Includes examples and best practices.
-
Updated
Apr 25, 2025 - Python
An automated pipeline to convert e-books into beautifully illustrated scenes using local AI backends ComfyUI and SD Forge.
-
Updated
Sep 28, 2025 - Python
TinyRag is a minimal Python library for retrieval-augmented generation. It offers easy document ingestion, automatic text extraction, embedding generation, and retrieval with vector stores. Designed for quick setup and flexible provider configuration, TinyRag enables fast, contextual responses from language models.
-
Updated
Aug 23, 2025 - Python
TinyRag is a minimal Python library for retrieval-augmented generation. It offers easy document ingestion, automatic text extraction, embedding generation, and retrieval with vector stores. Designed for quick setup and flexible provider configuration, TinyRag enables fast, contextual responses from language models.
-
Updated
Aug 23, 2025 - Python
Improve this page
Add a description, image, and links to the localllm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the localllm topic, visit your repo's landing page and select "manage topics."