FOSS LLM recommendation scan – llmfit
Evaluate which open-source Large Language Models (LLMs) your hardware can comfortably run. llmfit inspects your CPU, system RAM, GPU(s), VRAM, and accelerator configuration to recommend models across popular quantizations.
scoop install llmfit
0 comments