Skip to main content
Olostep is a built-in web search provider and web fetch backend in CowAgent, the open-source AI agent and assistant framework. Olostep is web data infrastructure for AI agents and enterprise AI workflows. Its APIs provide live web search, scraping and crawling to extract, clean and structure data from the web.
  • Web search: the agent’s web_search tool returns each result’s title, URL and description from Olostep.
  • Web fetch: the agent’s web_fetch tool reads pages through Olostep, which renders JavaScript and returns the page as markdown.
View CowAgent’s web search docs →

Why Olostep

  • Web data infrastructure for developers and enterprises
  • Scales to hundreds of millions to billions of requests per customer per month
  • The most performant, reliable and cost-effective API on the market
  • Used by the fastest-growing AI companies
From extracting data from a handful of URLs to crawling hundreds of millions of pages, Olostep gives developers, AI companies and enterprises reliable and highly cost-effective access to clean, structured web data at scale.

Setup

1

Get an API key

Create a key in the Olostep dashboard. Your first 500 credits are included.
2

Add the key to CowAgent

The easiest way is the CowAgent web console: open Model Management → Search, choose Olostep and save your key.Or set it in your configuration file:
You can also set the OLOSTEP_API_KEY environment variable instead.
3

Choose how CowAgent uses it

With the default auto strategy, CowAgent can use Olostep alongside any other search providers you configured. To always search with Olostep, use the fixed strategy:

Web fetch backend (opt-in)

CowAgent’s default fetch backend only reads static HTML. To read pages through Olostep instead, including JavaScript-heavy sites, set the fetch provider to olostep:
It uses the same key as the search provider. Each fetch uses Olostep credits, so it stays off until you turn it on. CowAgent still downloads and parses documents such as PDF and Word files locally.

Credits

Each search uses 5 credits, and each fetched page usually uses 1 credit. See pricing for plans.

Resources

CowAgent: web search

Providers, routing strategy and tool parameters

CowAgent: web fetch

Fetch backends, including Olostep

Olostep Search API

How Olostep search works