Working things out in public
Written while building, not after. Mostly about how generative models actually sample, why retrieval quality decides everything downstream, and what breaks in production.
Published 1
Drafting 2
FastAPI on Azure, honestly
What a Python inference service costs to run once the traffic is real: cold starts, worker counts, and the point where serverless stops being the cheap option.
In progressChunking is the whole ballgame
Retrieval failures usually get blamed on the model. Most of the time the answer was never in the retrieved context, because the document was cut in the wrong place.
In progressElsewhere
Some ideas explain better out loud than on a page. Those are heading for the video shelf — scripts are written, nothing is recorded yet.