PROJECT 7.3 / CONCURRENT CRAWLER
See how a website connects.
Give Orbit a public URL. A bounded fleet of goroutines will discover pages, measure responses, and return a clear site map.
01 Same-origin discovery02 Rate limited requests03 Network safety checks
GOWORKER FLEET
4/secRate limit
8 maxWorkers
CRAWL REPORT
go.dev
CrawlingGo workers are exploring the site
Discovered resources
Every page returned by the worker fleet.
StatusPage and URLLinksResponse