Skip to content
#

llm-deployment

Star

Here are 11 public repositories matching this topic...

Language: All
Filter by language
All 11 Python 4 Jupyter Notebook 2 JavaScript 1 Shell 1
Sort: Most stars
Sort options
Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

trustgraph-ai / trustgraph

Star 702

The production agentic context stack. Data streaming + knowledge graphs + vector search + LLM orchestration. All in a single deployment for self hosting, BYOC, or cloud.

data-engineering data-sovereignty model-serving ai-native agentic llm-deployment context-management agentic-framework graphrag llm-orchestration agentic-rag agentic-ai agentic-ai-development knowledge-core trustgraph agentic-graphrag context-engineering context-stack
  • Updated Nov 1, 2025
  • Python

BjornMelin / local-llm-workbench

Star 3

🧠 A comprehensive toolkit for benchmarking, optimizing, and deploying local Large Language Models. Includes performance testing tools, optimized configurations for CPU/GPU/hybrid setups, and detailed guides to maximize LLM performance on your hardware.

cuda gpu-acceleration model-management inference-optimization model-quantization cpu-inference llama-cpp local-llm llm-deployment llm-benchmarking ollama-optimization hybrid-inference wsl-ai-setup context-window-scaling
  • Updated Mar 27, 2025
  • Shell

Improve this page

Add a description, image, and links to the llm-deployment topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the llm-deployment topic, visit your repo's landing page and select "manage topics."

Learn more