Introduction
- The Olostep API is the best web search, scraping and crawling API for AI used by some of the leading startups in the world.
- The Olostep Agent allows to automate research workflows in a no code way with just a prompt in natural language.
Endpoints overview
These are the core Olostep’s endpoints:/scrapes →
Extract LLM-friendly Markdown, HTML, text or structured JSON from any URL in real time.
/crawls →
Recursively search through a URL’s subdomains and gather the content.
/maps →
Get all the URLs on a certain website.
/batches →
Process up to 10k URLs concurrently and retrieve the results after 5–7 minutes.
/answers →
Search the web and get direct LLM answers to questions with sources.
/parsers →
Turn unstructured data into structured, backend‑compatible data.
/agents →
Create, schedule and run custom agents to automate web research workflows.
/files →
Upload files to Olostep (for batches or to connect your internal knowledge base).
/sandboxes →
Spin up a VM in our cloud to let your agent use computer‑use models and interact with the web and legacy software. Write to us at info@olostep.com for access.