Tag:concurrency
All the articles with the tag "concurrency".
One Prompt, Thirty-Two Calls, or Seven
Batching an LLM checklist coarsens the calls and forces the retrieval finer, in the same design. A seeded simulation of three call shapes, the pigeonhole that decides what a grouped call can even see, and the omission that used to come back as a severe finding.