hnsk — a working index · № 01
BRIE
(a small-data fine-tuning study)
The same 1,213 hand-written examples, fine-tuned into four small models (0.5B–7B) holding one continental-philosophy register. Blind frontier-model judges prefer the fine-tunes to their base models, with no measurable out-of-domain regression. Total compute, at most, three dollars.
The 0.5B model was small enough to train on a laptop.
- medium
- LoRA r=16, four base models, ~$3 of GPU
- year
- 2025–2026
- venue
- Zenodo, DOI 10.5281/zenodo.17657737
- duration
- two epochs
- tags
- fine-tune · method · autobiography