Making Snif Fast Enough to Run on Every PR
How we removed redundant LLM calls, eliminated hard caps, added code embeddings, and built evidence verification into the review pipeline.
A repository with 5,000 symbols. One line changes. Snif re-summarized all 5,000 symbols, re-embedded all 5,000 summaries, then ran retrieval on the full set. Roughly 1,000 LLM calls and 5,000 embedding calls to review a single-line diff. 99% of those symbols hadn't changed since the last index. Thei...More ›