llmVramFit

ai.makerportal/compute · Verify this server

Decide whether one LLM fits one accelerator, at every quantization. The identical function that renders /lab/llm-vram/{model}/{gpu}. Returns one row per quantization (FP16 through Q3_K_M) with weight bytes and their basis, headroom, the largest context that fits, and the bandwidth-limited decode ceiling; plus the chosen best-fitting quant, the full-precision row, and a five-state verdict. Model geometry comes from each repo’s own config.json and tensor-shape index; accelerator capacity and bandwidth come from the site’s device table. Every result carries provenance.canonicalUrl — the published page for these exact inputs, or the lane hub when they are off the published grid.