Introduction
- The Olostep API is the best web search, scraping and crawling API for AI used by some of the leading startups in the world.
- The Olostep Agent allows to automate research workflows in a no code way with just a prompt in natural language.
Endpoints overview
These are the core Olostep’s endpoints:/scrapes →
Extract LLM-friendly Markdown, HTML, text or structured JSON from any URL in real time.
/crawls →
Recursively search through a URL’s subdomains and gather the content.
/maps →
Get all the URLs on a certain website.
/batches →
Process up to 10k URLs concurrently and retrieve the results after 5–7 minutes.
/answers →
Search the web and get direct LLM answers to questions with sources.
/searches →
Search the web and get direct relevant links with titles and descriptions.
/parsers →
Turn unstructured data into structured, backend‑compatible data.
/files →
Upload files to Olostep (for batches or to connect your internal knowledge base).
/schedules →
Schedule searches and scrapes to run automatically at specified times.
/agents →
Create, schedule and run custom agents to automate web research workflows.
Resources
Explore Features
Check out all supported features for your scraping and AI search needs.
API Reference
Start using the API and test out the various params.
Integrations
Use Olostep in n8n, make, relay, zapier, etc
Examples
Browse ready-to-use examples to get started quickly.