Maps
This endpoint allows users to get all the urls on a certain website. Uses cursor to paginate larger websites by limiting each response size to 10MB.
Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Body
The URL of the website for which you want the links
An optional search query to sort the links by search relevance.
An optional number to limit to only top n links for a search query.
URL path patterns to include using glob syntax. For example: /blog/**
to only include blog URLs. Only URLs matching these patterns will be returned.
URL path patterns to exclude using glob syntax. For example: /careers/**
. Excluded URLs will supersede included URLs.
OPTIONAL: Pagination cursor from a previous response. When provided, returns the next set of URLs from where the previous request left off due to response size limit.
Response
Number of URLs in the current response
Array of URLs found on the page
Unique identifier for this map
Pagination cursor to retrieve the next set of URLs limited due to 10MB size limit. If null or not present, all URLs have been retrieved.