Right-sizes LLM models to your system's RAM, CPU, and GPU
llmfit is a terminal tool that optimally matches LLM models to your system's hardware, assessing RAM, CPU, and GPU capabilities. It features an interactive TUI and CLI, supports multi-GPU setups, and dynamically selects quantization, making it essential for efficient AI model deployment.