How matching works
Hardware
Exact
GPU: vendor, model, VRAM, and system RAM. CPU: model and RAM. Apple: chip and unified memory. Missing details prevent an exact match.
Partial
Different or missing hardware details are shown separately. Equal memory capacity does not make devices equivalent.
Other hardware
Shown for reference; its speed is not a prediction for your setup.
Report groups
Separate by file, setup, runtime, task, and protocol. Manual reports are not combined with benchmarks.
Measurements
- Time to first token and prompt-processing rate are different.
- Input tokens tested are not the model's context limit.
- Sample counts and ranges are shown; failures remain visible.
- Submitted reports are not population failure rates.