Hardware

LoRA Fine-Tuning on NVIDIA B300 Blackwell Ultra

First published fine-tuning results on B300 Blackwell Ultra. FP4 is a different beast than FP8 — the exponent bits changed, and it changes everything about how LoRA gradients behave.

⏲
In progress
Full write-up coming soon
Full scaling curve from 1B to 72B. Dropping soon.
Built on this research

Everything in this article is measured, not promised. See it running:

Talk to NOESIS liveSee the 33x benchmarkBack the research