> ## Documentation Index
> Fetch the complete documentation index at: https://docs.olostep.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Welcome to Olostep

> Olostep is the Web Data API for AI and Research Agents.

Olostep offers AI a way to search the web, extract structured data in real time and build custom research agents.

<img src="https://mintcdn.com/olostep-58/ndWPtiE100GTiImQ/images/explainer_v5.png?fit=max&auto=format&n=ndWPtiE100GTiImQ&q=85&s=ae92c6f02390b885a46f830090b0de34" alt="Main dashboard interface" style={{ width: '100%', height: 'auto', maxHeight: 420, objectFit: 'contain' }} className="rounded-lg" width="2174" height="940" data-path="images/explainer_v5.png" />

## Introduction

* The **Olostep API** is the best **web search**, **scraping** and **crawling** API for AI used by some of the leading startups in the world.

* The **Olostep Agent** allows to automate **research workflows** in a no code way with just a prompt in natural language.

## Endpoints overview

These are the core Olostep's endpoints:

<CardGroup cols={1}>
  <Card title="/scrapes →" href="/features/scrapes">
    Extract LLM-friendly Markdown, HTML, text or structured JSON from any URL in real time.
  </Card>

  <Card title="/crawls →" href="/features/crawls">
    Recursively search through a URL’s subdomains and gather the content.
  </Card>

  <Card title="/maps →" href="/features/maps">
    Get all the URLs on a certain website.
  </Card>

  <Card title="/batches →" href="/features/batches">
    Process up to 10k URLs concurrently and retrieve the results after 5–7 minutes.
  </Card>

  <Card title="/answers →" href="/features/answers">
    Search the web and get direct LLM answers to questions with sources.
  </Card>

  <Card title="/searches →" href="/features/search">
    Search the web and get direct relevant links with titles and descriptions.
  </Card>

  <Card title="/parsers →" href="/features/structured-content/parsers">
    Turn unstructured data into structured, backend‑compatible data.
  </Card>

  <Card title="/files →" href="/features/files">
    Upload files to Olostep (for batches or to connect your internal knowledge base).
  </Card>

  <Card title="/schedules →" href="/features/schedules">
    Schedule searches and scrapes to run automatically at specified times.
  </Card>

  <Card title="/agents →" href="/features/agents">
    Create, schedule and run custom agents to automate web research workflows.
  </Card>
</CardGroup>

<br />

<br />

## Resources

<CardGroup cols={2}>
  <Card title="Explore Features" icon="graduation-cap" href="/features/scrapes">
    Check out all supported features for your scraping and AI search needs.
  </Card>

  <Card title="API Reference" icon="comment" href="/api-reference/scrapes/create">
    Start using the API and test out the various params.
  </Card>

  <Card title="Integrations" icon="plug" href="/integrations/n8n">
    Use Olostep in n8n, make, relay, zapier, etc
  </Card>

  <Card title="Examples" icon="code" href="/examples/">
    Browse ready-to-use examples to get started quickly.
  </Card>
</CardGroup>