Introducing Batches
scrape up to 100,000 URLs in a single job.
Submit a list of URLs or give us one starting URL to crawl from.
Choose from nine output formats for every page:
HTML, Markdown, screenshots, highlights, JSON, parsed data, images, bytes, and product data.
Get a webhook when it's done.
One batch. Up to 100,000 URLs per batch. GO.
“can you should stop launching on Friday nights, nobody’s even awake.” -
@michael_chomsky
Anyways, Introducing Batches
scrape 100,000 URLs in one shot.
give us up to 100K URLs, or just one and we’ll crawl from there.
9 output formats per page:
> HTML
> markdown
> screenshots
> highlights
> JSON
> parse
> images
> bytes
> product data.
Did I mention it's 100,000 urls?