Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.olostep.com/llms.txt

Use this file to discover all available pages before exploring further.

Olostep offers AI a way to search the web, extract structured data in real time and build custom research agents. Main dashboard interface

​
Introduction

  • The Olostep API is the best web search, scraping and crawling API for AI used by some of the leading startups in the world.
  • The Olostep Agent allows to automate research workflows in a no code way with just a prompt in natural language.
For AI agents: fetch https://docs.olostep.com/llms.txt for a complete index of this documentation before exploring further.

​
Use Olostep from your terminal and AI agents

Beyond the API, Olostep ships a CLI, an MCP server, and drop-in skills so any tool — Claude Code, Cursor, Windsurf, and more — can use the web natively.

CLI →

npm i -g olostep-cli — search, scrape, crawl, and batch from your terminal. JSON output for scripts, CI, and agents.

MCP Server →

Give any MCP client (Claude, Cursor, VS Code) live web tools. Hosted endpoint — no install.

Skills →

Drop-in skills that teach AI coding agents how and when to use Olostep. Install with olostep add skills.

​
Endpoints overview

These are the core Olostep’s endpoints:

/scrapes →

Extract LLM-friendly Markdown, HTML, text or structured JSON from any URL in real time.

/crawls →

Recursively search through a URL’s subdomains and gather the content.

/maps →

Get all the URLs on a certain website.

/batches →

Process up to 10k URLs concurrently and retrieve the results after 5–7 minutes.

/answers →

Search the web and get direct LLM answers to questions with sources.

/searches →

Search the web and get direct relevant links with titles and descriptions.

/parsers →

Turn unstructured data into structured, backend‑compatible data.

/files →

Upload files to Olostep (for batches or to connect your internal knowledge base).

/schedules →

Schedule searches and scrapes to run automatically at specified times.

/agents →

Create, schedule and run custom agents to automate web research workflows.


​
Resources

Explore Features

Check out all supported features for your scraping and AI search needs.

API Reference

Start using the API and test out the various params.

Integrations

Use Olostep in n8n, make, relay, zapier, etc

Examples

Browse ready-to-use examples to get started quickly.