Local Llm Tools
Browse our curated collection of specialized local llm utilities designed for modern AI developers.
Ollama Modelfile Builder
Build custom Ollama Modelfile configurations with GGUF base models, system parameters (temperature, top_p), and custom prompt templates.
GGUF VRAM Estimator
Calculate GPU VRAM requirements for running quantized GGUF models (Q4_K_M, Q8_0, etc.) with specified context window sizes across Nvidia GPUs.
vLLM Config Generator
Generate production-ready vLLM engine configurations and launch arguments including tensor parallel size, max model len, and GPU memory utilization.
Context Window Memory Calculator
Estimate KV cache memory consumption for transformer models across sequence lengths (8k, 32k, 128k) and concurrent batch sizes.
HuggingFace Modelcard Generator
Create comprehensive README.md model cards for Hugging Face Hub with metadata YAML, license tags, evaluation tables, and usage examples.
OpenWebUI Pipeline Configurator
Generate Python pipeline filters and valve configurations for OpenWebUI to customize RAG retrieval, moderation, and user prompts.