Skip to main content
Kilo is the all-in-one agentic engineering platform with support for MCP (Model Context Protocol) servers. The Olostep MCP Server integrates seamlessly with Kilo, giving your AI agent powerful web data capabilities.

​
Features

The Olostep MCP Server provides access to 5 core Olostep capabilities:

Scrape Website

Extract content from any single URL in multiple formats (Markdown, HTML, JSON, text)

Search Web

Search the web and get structured, parser-based results

Answers (AI)

Get AI-powered answers with natural language queries and citations

Batch Scrape URLs

Process up to 10,000 URLs in parallel. Perfect for large-scale data extraction

Crawl Websites

Autonomously discover and scrape entire websites by following links

​
Installation

​
1. Get Your API Key

Get your Olostep API key from the Olostep Dashboard.

​
2. Configure Kilo

In your project directory, create or edit .kilocode/mcp.json to add the Olostep MCP Server:
Replace YOUR_OLOSTEP_API_KEY with your actual API key from the Olostep Dashboard.

​
3. Verify Installation

Run Kilo and the Olostep tools should be automatically available:

​
Available Tools

Once configured, the following Olostep tools are available to your Kilo agent:

​
scrape_website

Extract content from a single URL. Supports multiple formats and JavaScript rendering. Example prompt:
Parameters:
  • url - Website URL to scrape (required)
  • format - Output format: markdown, html, json, or text (default: markdown)
  • country - Country code for location-specific content (e.g., “US”, “GB”)
  • wait_before_scraping - Wait time in milliseconds for JavaScript rendering (0-10000)
  • parser - Optional parser ID for specialized extraction (e.g., “@olostep/amazon-product”)

​
search_web

Search the web and return structured, parser-based results. Example prompt:
Parameters:
  • query - Search query (required)
  • country - Country code for location-specific results

​
answers

Get AI-powered answers from web searches with sources and citations. Example prompt:
Parameters:
  • query - Natural language question (required)
  • format - Output format for answers (JSON structure of your choice)
  • country - Country code for location-specific searches

​
batch_scrape_urls

Process multiple URLs in parallel. Perfect for large-scale data extraction. Example prompt:
Parameters:
  • urls - Array of URLs to scrape (required)
  • format - Output format for all URLs
  • country - Country code for location-specific content
  • parser - Optional parser ID for all URLs

​
create_crawl

Autonomously discover and scrape entire websites by following links from a start URL. Example prompt:
Parameters:
  • start_url - Starting URL for the crawl (required)
  • max_pages - Maximum number of pages to crawl (default: 10). Set to 1 to scrape only the start URL.

​
create_map

Extract all URLs from a website for site structure analysis and content discovery. Example prompt:
Parameters:
  • website_url - Website to map (required)
  • search_query - Optional query to filter results
  • top_n - Limit number of returned URLs

​
Example Workflows

Let Kilo agent gather information from the web:

​
Product Data Extraction

Scrape multiple product pages:

​
Website Discovery and Analysis

Crawl and analyze a website structure:

​
Environment Variables

When using the local/stdio configuration, make sure your environment has the API key set:
Or in your .env file:

​
Troubleshooting

Tools not appearing in Kilo:
  • Verify the .kilocode/mcp.json is properly formatted (valid JSON)
  • Ensure your API key is correct in the configuration
  • Try restarting Kilo after configuration changes
API key authentication errors:
  • Double-check your API key from the Olostep Dashboard
  • Make sure there are no extra spaces or special characters in the key
Remote hosted MCP not connecting:
  • Verify your internet connection
  • Check that https://mcp.olostep.com/mcp is accessible
  • Ensure the Authorization header format is correct: Bearer YOUR_KEY

​
Learn More