All workFILE 10 / 16
Market intelligence
A week of analysis in under an hour
Shipped for A market-intelligence startup · led by Nikhil Bery
01
The problem
Industry analysis over 100,000+ keywords took analysts roughly a week per run.
02
The constraint
A single run spans 100,000+ keywords, so speed could not come at the cost of coverage or accuracy at that scale.
03
The system
A 7-stage pipeline from keyword crawling through semantic clustering, a 3-pass LLM extraction with self-reflection, and anti-detection marketplace scraping, shipped with a client-facing UI.
FIG. 01 · SYSTEM FLOW · 6 NODES · 5 FLOWS
04
The outcome
Roughly a 100x speedup, from about a week of manual work to under an hour, across 100,000+ keywords.