The Batch endpoint allows to process multiple URLs at the same time, making it easier to get content quickly from very large sets of urls. You can start a batch of up to 10k urls at a time and retrieve the content after 5-8 mins. You can start many batches in parallel to do up to 1 million requests in around 30 minutes.

How to use the Batch endpoint

To initiate a new batch, specify the items to be processed with their custom_id which is the unique identifier and url which is the url from which you want to get the content. You can also provide optional parameters such as the country and parser to be used for the batch.

In the example below, we will create a batch of 10 Google Search URLs and retrieve the structured JSON of the search results with the pre-built parser @olostep/google-search

import requests
import hashlib
import time

API_KEY = "<YOUR_API_KEY>"  # Replace with your actual API key
API_URL = "https://api.olostep.com/v1"


# Step 1: Utilities
def create_hash_id(url):
    return hashlib.sha256(url.encode()).hexdigest()[:16]


def compose_items_array():
    urls = [
        "https://www.google.com/search?q=ecommerce+platform&gl=us&hl=en",
        "https://www.google.com/search?q=payment+gateway&gl=us&hl=en",
        "https://www.google.com/search?q=stripe&gl=us&hl=en",
        "https://www.google.com/search?q=paddle&gl=us&hl=en",
        "https://www.google.com/search?q=merchant+of+record&gl=us&hl=en",
        "https://www.google.com/search?q=saas+payments&gl=us&hl=en",
        "https://www.google.com/search?q=digital+river&gl=us&hl=en",
        "https://www.google.com/search?q=subscription+billing&gl=us&hl=en",
        "https://www.google.com/search?q=online+payments&gl=us&hl=en",
        "https://www.google.com/search?q=braintree&gl=us&hl=en"
    ]

    # Add the parser configuration to each item
    items = []
    for url in urls:
        items.append({
            "custom_id": create_hash_id(url),
            "url": url,
        })

    return items


# Step 2: Start batch
def start_batch(items):
    payload = {
        "items": items,
        "country": "US",
        "parser": {"id": "@olostep/google-search"}
    }
    headers = {
        "Authorization": f"Bearer {API_KEY}",
        "Content-Type": "application/json"
    }
    response = requests.post(f"{API_URL}/batches", headers=headers, json=payload)
    response.raise_for_status()
    return response.json()["id"]


# Step 3: Wait for completion
def check_batch_status(batch_id):
    headers = {"Authorization": f"Bearer {API_KEY}"}
    response = requests.get(f"{API_URL}/batches/{batch_id}", headers=headers)
    response.raise_for_status()
    return response.json()["status"]


def wait_until_complete(batch_id):
    print("Waiting for batch to complete...")
    while True:
        status = check_batch_status(batch_id)
        print("Status:", status)
        if status == "completed":
            print("Batch completed!")
            return
        time.sleep(10)


# Step 4: Get items
def get_completed_items(batch_id):
    headers = {"Authorization": f"Bearer {API_KEY}"}
    response = requests.get(f"{API_URL}/batches/{batch_id}/items", headers=headers)
    response.raise_for_status()
    return response.json()["items"]


# Step 5: Retrieve content with format specified
def retrieve_content(retrieve_id):
    url = f"{API_URL}/retrieve"
    headers = {"Authorization": f"Bearer {API_KEY}"}
    params = {
        "retrieve_id": retrieve_id,
        "formats": ["markdown", "json"]
    }
    response = requests.get(url, headers=headers, params=params)
    response.raise_for_status()
    return response.json()


# Step 6: Run end-to-end flow
if __name__ == "__main__":
    print("Composing batch...")
    items = compose_items_array()

    print("Starting batch...")
    batch_id = start_batch(items)
    print("Batch ID:", batch_id)
    print(f"You can check the status of the batch at: {API_URL}/batches/{batch_id}?token={API_KEY}")

    wait_until_complete(batch_id)

    print("Fetching completed items...")
    completed_items = get_completed_items(batch_id)

    print("Retrieving content...")
    for item in completed_items:
        retrieve_id = item["retrieve_id"]
        print(f"\nRetrieving content for item {item['retrieve_id']}...")
        content = retrieve_content(retrieve_id)
        print(f"\n---\nURL: {item['url']}\nCustom ID: {item['custom_id']}\n")
        #print("Markdown:\n", content.get("markdown_content", "[No markdown found]"))
        print("JSON:\n", content.get("json_content", "[No JSON found]"))

        # If you want to see the parsed content specifically
        if "parsed_content" in content:
            print("\nParsed Content:")
            print(content["parsed_content"])

Response Format

When you run the above code, you will receive a response like the following


Waiting for batch to complete...
Status: in_progress
Status: completed
Batch completed!
Fetching completed items...
Retrieving content...

Retrieving content for item 4pjtky4don_86b1f04cec364903...

---
URL: https://www.google.com/search?q=ecommerce+platform&gl=us&hl=en
Custom ID: 86b1f04cec364903

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"ecommerce platform"},"knowledgeGraph":{"description":"Dec 6, 2024 — To help your business make the right decision, we compare top ecommerce platforms and provide key steps for finding the perfect solution."},"organic":[{"title":"9 Best Ecommerce Platforms of 2025 (Know Your Options)","link":"https://www.bigcommerce.com/articles/ecommerce/ecommerce-platforms/","position":1,"snippet":"Dec 6, 2024 — To help your business make the right decision, we compare top ecommerce platforms and provide key steps for finding the perfect solution."},{"title":"Top 10 Ecommerce Sites in India","link":"https://ecommerceguide.com/top/top-10-ecommerce-sites-in-india/","position":2},{"title":"11 Best Ecommerce Platforms for Your Business in 2025","link":"https://www.shopify.com/blog/best-ecommerce-platforms","position":3,"snippet":"The 11 best ecommerce platforms. Shopify; Wix; BigCommerce; Adobe Commerce; WooCommerce; Squarespace; Big Cartel; Square Online; Shift4Shop; Volusion; OpenCart ..."},{"title":"What is an Ecommerce Platform?","link":"https://www.salesforce.com/commerce/ecommerce-platform/","position":4,"snippet":"An ecommerce platform is software that helps businesses set up and run an online store. It handles product displays, payment processing, order management, and ..."},{"title":"10 Best E-Commerce Platforms Of 2025","link":"https://www.forbes.com/advisor/business/software/best-ecommerce-platform/","position":5,"snippet":"Dec 19, 2024 — 10 Best E-Commerce Platforms Of 2025 · Ecwid · Shift4Shop · Squarespace · BigCommerce · Web.com · Shopify · OpenCart · Big Cartel ..."},{"title":"#1 Ecommerce Shopping Cart & Online Store - Try Ecwid!","link":"https://www.ecwid.com/","position":6,"snippet":"Control everything from a single platform with centralized inventory, order management, and pricing. Get started. Sell everywhere Sell on ..."},{"title":"WooCommerce","link":"https://woocommerce.com/","position":7,"snippet":"WooCommerce empowers you to build, sell, and grow on your terms. Our WordPress-powered platform offers fully customizable ecommerce, for less."},{"title":"eCommerce Website Builder: Build An eCommerce Site","link":"https://www.wix.com/ecommerce/website","position":8,"snippet":"Wix eCommerce is your all-in-one eCommerce platform. Create a fully customizable free eCommerce website & upgrade to start selling everywhere."},{"title":"What E-Commerce platform do you use and why?","link":"https://www.reddit.com/r/ecommerce/comments/1cwo1uo/what_ecommerce_platform_do_you_use_and_why/","position":9,"snippet":"Shopify is hands down one of the best e-commerce platforms. Shopify has a user-friendly interface that simplifies store setup and management."}],"peopleAlsoAsk":[{"question":"What is an ecommerce platform?"},{"question":"What is the best ecommerce platform?"},{"question":"What are the top 5 e-commerce websites?","link":"https://ecommerceguide.com/top/top-10-ecommerce-sites-in-india/","title":"Top 10 Ecommerce Sites in India"},{"question":"What are the 3 types of e-commerce?"}],"relatedSearches":[{"query":"Ecommerce platform examples"},{"query":"e-commerce platforms list"},{"query":"Best ecommerce platform"},{"query":"Best ecommerce platform for beginners"},{"query":"Cheapest ecommerce platform"},{"query":"Best ecommerce platform for small business"},{"query":"Is Amazon an ecommerce platform"},{"query":"Best ecommerce platform for clothing"}]}

Retrieving content for item 4pjtky4don_5d0195299a727a71...

---
URL: https://www.google.com/search?q=payment+gateway&gl=us&hl=en
Custom ID: 5d0195299a727a71

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"payment gateway"},"knowledgeGraph":{"title":"Payment gateway","description":"A payment gateway is a merchant service provided by an e-commerce application service provider that authorizes credit card or direct payment processing for e-businesses, online retailers, bricks and clicks, or traditional brick and mortar.","imageUrl":"https://www.investopedia.com/terms/p/payment-gateway.asp"},"organic":[{"title":"What Is a Payment Gateway? How It Works and Example","link":"https://www.investopedia.com/terms/p/payment-gateway.asp","position":1,"snippet":"A payment gateway is the front-end technology that reads payment cards and sends customer information to the merchant acquiring bank for processing."},{"title":"What are payment gateways? - Stripe","link":"https://stripe.com/resources/more/payment-gateways-101#:~:text=A%20payment%20gateway%20is%20a,a%20secure%20and%20efficient%20manner.","position":2},{"title":"Online payment gateways bring these 5 benefits. - Binary Stream","link":"https://binarystream.com/online-payment-gateways-bring-these-5-benefits/","position":3},{"title":"What are payment gateways?","link":"https://stripe.com/resources/more/payment-gateways-101","position":4,"snippet":"Oct 16, 2023 — A payment gateway is a technology platform that acts as an intermediary in electronic financial transactions. It enables in-person and online ..."},{"title":"9 Best Payment Gateways Of 2025","link":"https://www.forbes.com/advisor/business/software/best-payment-gateways/","position":5,"snippet":"Jan 28, 2025 — 9 Best Payment Gateways Of 2025 · Helcim · PayPal · Shopify · Square · Payline · Clover · Authorize.net · Stripe; Stax. Table of Contents. Table ..."},{"title":"Payment processing: Accept payments anywhere | Authorize.net","link":"https://www.authorize.net/","position":6,"snippet":"Dec 16, 2024 — Accept credit cards, contactless payments, and eChecks in person and on the go. Contact us to learn more by calling 1-888-323-4289."},{"title":"Payment Gateways in 2025: Main Types + How They Work","link":"https://www.bigcommerce.com/articles/ecommerce/payment-gateways/","position":7,"snippet":"Payment gateways are a merchant service that processes credit card payments for both ecommerce sites and traditional brick-and-mortar stores. They can be ..."},{"title":"Payment Gateway, Merchant Services, B2B AR Automation ...","link":"https://paytrace.net/","position":8,"snippet":"Accept payments anywhere with our flexible payment platform. We make it simple and seamless for merchants to accept payments online, in person, and on the go."},{"title":"What Is A Payment Gateway And Why Do I Need One?","link":"https://corporate.freedompay.com/resources/blogs/what-is-a-payment-gateway-and-why-do-i-need-one","position":9,"snippet":"A payment gateway is a software program that sits between the merchant and their customer. It's often described as 'an electronic cash register for the virtual ..."},{"title":"What is a Payment Gateway and how does it work?","link":"https://gocardless.com/en-us/guides/posts/payment-gateways/","position":10,"snippet":"A payment gateway is a tool that securely validates your customer's credit card details, ensuring funds are available for you to get paid."}],"peopleAlsoAsk":[{"question":"What is a payment gateway?","link":"https://stripe.com/resources/more/payment-gateways-101#:~:text=A%20payment%20gateway%20is%20a,a%20secure%20and%20efficient%20manner.","title":"What are payment gateways? - Stripe"},{"question":"What's the best payment gateway?"},{"question":"Is PayPal a payment gateway?"},{"question":"Is Zelle a payment gateway?","link":"https://www.fiserv.com/en/lp/how-zelle-works.html#:~:text=Zelle%20is%20a%20P2P%20payments,credit%20union%20that%20offers%20Zelle.","title":"How Zelle Works - Fiserv"}],"relatedSearches":[{"query":"Payment gateway price"},{"query":"Payment gateway list"},{"query":"Payment gateway PayPal"},{"query":"Payment gateway login"},{"query":"Payment gateway vs payment processor"},{"query":"Types of payment gateway"},{"query":"Payment gateway for website"},{"query":"Payment gateway free"}]}

Retrieving content for item 4pjtky4don_f42462f1e5bb954d...

---
URL: https://www.google.com/search?q=braintree&gl=us&hl=en
Custom ID: f42462f1e5bb954d

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"braintree"},"knowledgeGraph":{"title":"Braintree","type":"Company","description":"PayPal Braintree is a global payment processing solution that delivers end-to-end checkout experiences for businesses, offering single-touch payments, mobile ...","imageUrl":"https://commons.wikimedia.org/wiki/File:Braintree_logo.svg","attributes":{"Founder":"Bryan Johnson","Parent organization":"PayPal","Founded":"October 22, 2007","Company location":"Chicago, Illinois","Headquarters":"Chicago, Illinois, United States","Number of employees":"500+ (2016)"}},"organic":[{"title":"Braintree | Enterprise Payment Solution","link":"https://www.paypal.com/us/braintree","position":1,"snippet":"PayPal Braintree is a global payment processing solution that delivers end-to-end checkout experiences for businesses, offering single-touch payments, mobile ..."},{"title":"Braintree vs. Paypal: Which is Better for Payment Processing - Tipalti","link":"https://tipalti.com/resources/learn/braintree-vs-paypal/#:~:text=Braintree%20offers%20more%20fraud%20protection,cryptocurrency%20buy%20and%20sell%20transactions.","position":2},{"title":"Braintree, MA | Official Website","link":"https://www.braintreema.gov/","position":3,"snippet":"Braintree Town Hall ... Town Hall is open Mon, Wed, Thur 8:30 AM to 4:30 PM, Tue 8:30 AM - 7:00 PM, Fri 8:30 AM - 1:00 PM."},{"title":"Braintree (company)","link":"https://en.wikipedia.org/wiki/Braintree_(company)","position":4,"snippet":"Braintree is a Chicago-based company that primarily deals in mobile and web payment systems for e-commerce companies. The company was acquired by PayPal on ..."},{"title":"Braintree Payment Gateway: Features, Pricing And Reviews","link":"https://staxpayments.com/blog/braintree-payment-gateway/#:~:text=Braintree%20offers%20transparent%20pricing%20with%20a%20fee%20of%202.59%25%20plus,2.9%25%20plus%20%240.30%20per%20transaction.","position":5},{"title":"Braintree Scientific","link":"https://www.braintreesci.com/","position":6,"snippet":"We are a women owned small business, dedicated to providing new product technology and supplies to advance medical milestones for all. You've seen our unique ..."},{"title":"HOME | Braintree Academy","link":"https://www.braintree4me.com/","position":7,"snippet":"Braintree Academy is a tuition-free, virtual public school program tailored to the unique needs of each student and family."},{"title":"Braintree, Massachusetts","link":"https://en.wikipedia.org/wiki/Braintree,_Massachusetts","position":8,"snippet":"Braintree is a municipality in Norfolk County, Massachusetts, United States. It is officially known as a town, but Braintree is a city with a mayor-council ..."},{"title":"BrainTree Nutrition Collection | Brain Health Supplements","link":"https://www.braintreenutrition.com/collections/all?srsltid=AfmBOor3eehM1T3xOqtn2i1wApxaWrFtRMoOCp6en_4X24_JXoYoWptj","position":9,"snippet":"We offer the finest nutritional products for cognitive enhancement, brain health and anti-aging. Fortify long-lasting brain health and unrivaled cognitive power ..."},{"title":"Braintree Gateway Login","link":"https://www.braintreegateway.com/login","position":10,"snippet":"A username can be either: A unique identifier designated by you at signup (e.g. yourusername100); The email you signed up with (e.g. example@email.com)."},{"title":"PayPal Braintree Fees & Pricing","link":"https://www.paypal.com/us/enterprise/paypal-braintree-fees","position":11,"snippet":"Custom flat rates, interchange plus pricing, and discounted rates are available for established businesses based on business model and processing volume."}],"peopleAlsoAsk":[{"question":"What is Braintree used for?"},{"question":"How much did Bryan Johnson sell Braintree for?"},{"question":"What is the difference between PayPal and Braintree?","link":"https://tipalti.com/resources/learn/braintree-vs-paypal/#:~:text=Braintree%20offers%20more%20fraud%20protection,cryptocurrency%20buy%20and%20sell%20transactions.","title":"Braintree vs. Paypal: Which is Better for Payment Processing - Tipalti"},{"question":"Is Braintree the same as Venmo?","link":"https://en.wikipedia.org/wiki/Braintree_(company)#:~:text=In%202012%2C%20Braintree%20acquired%20Venmo%20for%20%2426.2%20million.","title":"Braintree (company) - Wikipedia"}],"relatedSearches":[{"query":"Braintree pricing"},{"query":"Braintree login"},{"query":"Braintree PayPal"},{"query":"Braintree payments"},{"query":"Braintree school"},{"query":"Braintree company"},{"query":"Braintree sandbox"},{"query":"Braintree city"}]}

Retrieving content for item 4pjtky4don_256e5f8ec1074fca...

---
URL: https://www.google.com/search?q=digital+river&gl=us&hl=en
Custom ID: 256e5f8ec1074fca

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"digital river"},"knowledgeGraph":{"title":"Digital River","type":"E-commerce company","description":"Digital River, Inc. was a privately held company headquartered in Minnetonka, Minnesota that provides global e-commerce, payments and marketing services.","imageUrl":"https://www.digitalriver.com/","attributes":{"Headquarters":"Minnetonka, MN","CEO":"Adam Coyle (Jul 10, 2018–)","Founder":"Joel A. Ronning","Founded":"February 1994","Number of employees":"122 (2025)","Traded as":"Nasdaq: DRIV (1998–2015)"}},"organic":[{"title":"Digital River","link":"https://en.wikipedia.org/wiki/Digital_River","position":1,"snippet":"Digital River, Inc. was a privately held company headquartered in Minnetonka, Minnesota that provides global e-commerce, payments and marketing services."},{"title":"US paytech Digital River reportedly shutting down","link":"https://www.fintechfutures.com/2025/02/us-paytech-digital-river-reportedly-shutting-down/#:~:text=Founded%20in%201994%2C%20Digital%20River,%2C%20Salesforce%2C%20and%20American%20Express.","position":2},{"title":"US paytech Digital River reportedly shutting down","link":"https://www.fintechfutures.com/digital-payments/us-paytech-digital-river-reportedly-shutting-down","position":3,"snippet":"Feb 11, 2025 — US-based payments firm Digital River is reportedly winding down its operations, according to local media outlet The Minnesota Star Tribune."},{"title":"Minnetonka-based E-Commerce Firm Digital River to Shut ...","link":"https://tcbmag.com/minnetonka-based-e-commerce-firm-digital-river-to-shut-down/","position":4,"snippet":"Jan 28, 2025 — Minnetonka-based e-commerce firm Digital River is laying off 122 employees locally and winding down global operations elsewhere."},{"title":"Renew Digital River subscriptions directly with Adobe","link":"https://helpx.adobe.com/x-productkb/policy-pricing/digital-river-deprecation-adobe.html#:~:text=Why%20can't%20I%20get%20a%20refund%20for%20my%20purchase,any%20inconvenience%20this%20may%20cause.","position":5},{"title":"I have a \"Digital River\" transaction on my bank statement ...","link":"https://www.reddit.com/r/personalfinance/comments/daj103/i_have_a_digital_river_transaction_on_my_bank/","position":6,"snippet":"Digital River is a legitimate e-commerce vendor. They help businesses setup their online stores. Have you made any online purchases recently?"},{"title":"Digital River (@DigitalRiverInc) / X","link":"https://x.com/digitalriverinc?lang=en","position":7,"snippet":"Jul 2, 2024 — The ultimate ecommerce accelerator for global growth. Fast, easy, risk-free expansion into 240+ destinations. Accelerate. Simplify. Optimize."},{"title":"Digital River","link":"https://www.linkedin.com/company/digital-river","position":8,"snippet":"We're proactive partners, providing API-based Cross-Border, Order Management and Ecommerce services to leading enterprise brands.","meta":"68.9K+ followers"},{"title":"Digital River Insolvency: A Guide for Affected Software ...","link":"https://freemius.com/blog/digital-river-mycommerce-shutdown-guide/","position":9,"snippet":"Jan 31, 2025 — Digital River abruptly laid off over 100 employees and filed for insolvency, leaving software creators in the lurch, unable to access their hard-earned revenue."},{"title":"Digital River cuts staff and will close headquarters","link":"https://www.digitalcommerce360.com/2025/01/29/digital-river-cuts-staff-will-shut-down-headquarters/","position":10,"snippet":"Jan 29, 2025 — The company will close its Minnesota headquarters by the end of March, impacting 122 employees, including remote workers nationwide."},{"title":"Connecting with Digital River","link":"https://support.bigcommerce.com/s/article/Connecting-with-Digital-River","position":11,"snippet":"Digital River is a global online payments platform engineered to maximize conversions and grow revenue. Digital River partners with the world's leading ..."},{"title":"Who is Digital River Ireland, Ltd.","link":"https://www.paypal-community.com/t5/Security-and-Fraud/Who-is-Digital-River-Ireland-Ltd/td-p/3055369","position":12,"snippet":"Apr 17, 2023 — Digital river is an ecommerce payment company. They don't fraudulently take your money. They partner with companies like Samsung, Microsoft, ..."}],"peopleAlsoAsk":[{"question":"Is Digital River still in business?"},{"question":"What is the Digital River?","link":"https://www.fintechfutures.com/2025/02/us-paytech-digital-river-reportedly-shutting-down/#:~:text=Founded%20in%201994%2C%20Digital%20River,%2C%20Salesforce%2C%20and%20American%20Express.","title":"US paytech Digital River reportedly shutting down"},{"question":"How do I stop my Digital River subscription?","link":"https://emma-app.com/how-to-cancel-digital-river#:~:text=To%20cancel%20a%20Digital%20River,contact%20their%20customer%20service%20there.","title":"How To Cancel Digital River - Emma app"},{"question":"What is happening at Digital River?","link":"https://gappgroup.com/blog/digital-river-is-shutting-down-heres-how-gapp-group-can-seamlessly-support-its-customers/#:~:text=The%20eCommerce%20industry%20was%20recently,before%20their%20operations%20are%20disrupted.","title":"Digital River Is Shutting Down – Here's How Gapp Group Can ..."}],"relatedSearches":[{"query":"Digital River payment"},{"query":"Digital River charge on credit card"},{"query":"Digital River subscription"},{"query":"Digital river complaints"},{"query":"Digital river app"},{"query":"Digital River Adobe"},{"query":"Digital River news"},{"query":"Digital River NVIDIA"}]}

Retrieving content for item 4pjtky4don_625d3a44aeb9123b...

---
URL: https://www.google.com/search?q=online+payments&gl=us&hl=en
Custom ID: 625d3a44aeb9123b

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"online payments"},"knowledgeGraph":{"description":"Pay your income tax, property tax, college tuition, utility and other bills online with a credit card, debit card or other convenient option."},"organic":[{"title":"ACI Payments, Inc. - Pay Taxes, Utility Bills, Tuition & More ...","link":"https://www.officialpayments.com/","position":1,"snippet":"Pay your income tax, property tax, college tuition, utility and other bills online with a credit card, debit card or other convenient option."},{"title":"The 6 best online payment processing services in 2025 - Zapier","link":"https://zapier.com/blog/best-payment-gateways/","position":2},{"title":"Pay, Send and Save Money with PayPal | PayPal US","link":"https://www.paypal.com/","position":3,"snippet":"Tap to pay safely in stores with the PayPal Debit Card and earn rewards online with PayPal checkout. Get even more cash back on the brands you love."},{"title":"Online Payments Made Simple | Pay.com","link":"https://pay.com/","position":4,"snippet":"Pay.com lets you easily accept online payments and grow your revenue. Start accepting credit and debit cards, digital wallets, and other payment methods."},{"title":"Payments | Internal Revenue Service","link":"https://www.irs.gov/payments","position":5,"snippet":"View amount due, payment plan details, payment history and scheduled payments; Pay separate assessment payments. Pay in online account. Business Tax Account."},{"title":"Seamlessly Pay Online, Pay In Stores or Send Money","link":"https://pay.google.com/about/","position":6,"snippet":"Google Pay is a quick, easy, and secure way to pay online, in stores or send money to friends and family. Pay the Google way."},{"title":"Stripe | Financial Infrastructure to Grow Your Revenue","link":"https://stripe.com/","position":7,"snippet":"Stripe powers online and in-person payment processing and financial solutions for businesses of all sizes. Accept payments, send payouts, and automate ..."},{"title":"Collecting online payments: How It works","link":"https://stripe.com/guides/introduction-to-online-payments","position":8,"snippet":"This guide offers a high-level overview of online payments and covers nuances based on different business models. Learn more."},{"title":"The Best Online Payment Service Providers in 2023","link":"https://www.wildapricot.com/blog/online-payment-services","position":9,"snippet":"Jul 14, 2023 — The Top 11 Best Online Payment Systems For Your Organization · 1. WildApricot Payments · 2. Stripe · 3. Apple Pay · 4. Dwolla · 5. Due · 6."},{"title":"Pay.gov - Home","link":"https://www.pay.gov/","position":10,"snippet":"Pay an overdue debt to the Bureau of the Fiscal Service. Do you want to make a payment toward a federal non-tax debt (not an IRS tax debt or student loan debt)?."}],"peopleAlsoAsk":[{"question":"Which site is best for online payments?","link":"https://zapier.com/blog/best-payment-gateways/","title":"The 6 best online payment processing services in 2025 - Zapier"},{"question":"Which is best for online payments?","link":"https://www.dsgpay.com/blog/digital-payment-services-in-india/","title":"10 Best Digital Payment Services in India 2024: Pros and Cons - DSGPay"},{"question":"What is meant by online payment?","link":"https://www.pinelabs.com/blog/online-payments-and-its-types-methods-and-meaning#:~:text=Online%20payment%20allows%20you%20to,net%20banking%2C%20and%20digital%20wallets.","title":"What is Online Payment? Types, Modes, Methods, Meaning"},{"question":"What is the best way to pay online?"}],"relatedSearches":[{"query":"Free online payments"},{"query":"Online payments credit card"},{"query":"IRS payment online"},{"query":"Online payments app"},{"query":"ACI Payments online"},{"query":"Pay estimated taxes online"},{"query":"ACI pay online Customer Service"},{"query":"PayPal"}]}

Retrieving content for item 4pjtky4don_bd045d49c210b22a...

---
URL: https://www.google.com/search?q=stripe&gl=us&hl=en
Custom ID: bd045d49c210b22a

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"stripe"},"knowledgeGraph":{"title":"Stripe, Inc.","type":"Financial services company","description":"Reduce costs, grow revenue, and run your business more efficiently on a fully integrated platform. Use Stripe to handle all of your payments-related needs, ...","website":"http://stripe.com/","imageUrl":"http://t3.gstatic.com/images?q=tbn:ANd9GcSJHbnfk81kA_5mIj81yhRy3R2LRx3S11OyMjC68QeONsOp5DXx","attributes":{"Founders":"Patrick Collison, John Collison","Headquarters":"Dublin, Ireland","CEO":"Patrick Collison (2010–)","Revenue":"14.4 billion USD (2022)","Founded":"2010, San Francisco, CA","Number of employees":"8,500 (2025)"}},"organic":[{"title":"Stripe | Financial Infrastructure to Grow Your Revenue","link":"https://stripe.com/","position":1,"snippet":"Reduce costs, grow revenue, and run your business more efficiently on a fully integrated platform. Use Stripe to handle all of your payments-related needs, ...","sitelinks":[{"title":"Login","link":"https://dashboard.stripe.com/login"},{"title":"Create your Stripe account","link":"https://dashboard.stripe.com/register"},{"title":"Jobs","link":"https://stripe.com/jobs"},{"title":"Pricing & Fees","link":"https://stripe.com/pricing"},{"title":"Support","link":"https://support.stripe.com/"}]},{"title":"What Is Stripe, and How Does It Work to Accept Payments? - NerdWallet","link":"https://www.nerdwallet.com/article/small-business/what-is-stripe#:~:text=Stripe%20is%20a%20payment%20processing,platform's%20developer%20tools%20and%20customizability.","position":2},{"title":"Stripe - X","link":"https://x.com/stripe?lang=en","position":3,"snippet":"Stripe is a global technology company that builds economic infrastructure for the internet. Help: @stripesupport. Read: @stripepress. Status: @stripestatus."},{"title":"Stripe, Inc.","link":"https://en.wikipedia.org/wiki/Stripe,_Inc.","position":4,"snippet":"Stripe is the largest privately-owned fintech company with a valuation of about $91 billion and over $1.4 trillion in payment volume processed in 2024."},{"title":"Stripe","link":"https://www.linkedin.com/company/stripe","position":5,"snippet":"Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ...","meta":"1M+ followers"}],"peopleAlsoAsk":[{"question":"What does Stripe exactly do?","link":"https://www.nerdwallet.com/article/small-business/what-is-stripe#:~:text=Stripe%20is%20a%20payment%20processing,platform's%20developer%20tools%20and%20customizability.","title":"What Is Stripe, and How Does It Work to Accept Payments? - NerdWallet"},{"question":"Is Stripe owned by Elon Musk?","link":"https://en.wikipedia.org/wiki/Stripe,_Inc.#:~:text=In%202011%20the%20company%20received,Andreessen%20Horowitz%2C%20and%20SV%20Angel.","title":"Stripe, Inc. - Wikipedia"},{"question":"What is Stripe and is it legit?","link":"https://www.acodei.com/blog/is-stripe-safe-and-secure#:~:text=Stripe%20is%20a%20highly%20secure%20payment%20platform%20trusted%20by%20businesses%20worldwide.","title":"Is Stripe Safe and Secure? - Acodei Blog"},{"question":"How much is the Stripe fee for $100?"}],"relatedSearches":[{"query":"Stripe fees"},{"query":"Stripe login"},{"query":"Stripe careers"},{"query":"Stripe Express"},{"query":"Stripe sign up"},{"query":"Stripe Dashboard"},{"query":"Stripe payment"},{"query":"Stripe logo"}]}

Retrieving content for item 4pjtky4don_228d8979b098d94d...

---
URL: https://www.google.com/search?q=subscription+billing&gl=us&hl=en
Custom ID: 228d8979b098d94d

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"subscription billing"},"knowledgeGraph":{"description":"Stripe Billing lets you bill and manage customers however you want—from simple recurring billing to usage-based billing and sales-negotiated contracts."},"organic":[{"title":"Stripe Billing | Recurring Payments & Subscription ...","link":"https://stripe.com/billing","position":1,"snippet":"Stripe Billing lets you bill and manage customers however you want—from simple recurring billing to usage-based billing and sales-negotiated contracts."},{"title":"Find your purchases, reservations & subscriptions - Android - Google Help","link":"https://support.google.com/accounts/answer/7673989?hl=en&co=GENIE.Platform%3DAndroid","position":2},{"title":"Subscription billing overview - Finance | Dynamics 365","link":"https://learn.microsoft.com/en-us/dynamics365/finance/accounts-receivable/subscription-billing-summary","position":3,"snippet":"Mar 13, 2024 — Subscription billing enables organizations to manage subscription revenue opportunities and recurring billing through billing schedules."},{"title":"What is Subscription Billing?","link":"https://dealhub.io/glossary/subscription-billing/","position":4,"snippet":"Sep 8, 2024 — Subscription billing is a type of recurring billing in which customers are charged a set amount at regular intervals for a service or product."},{"title":"What is Subscription Billing? A Guide for SaaS Businesses","link":"https://www.younium.com/blog/what-is-subscription-billing","position":5,"snippet":"Subscription billing involves collecting recurring payments from customers automatically at set intervals. With this model, you require your subscribers to sign ..."},{"title":"Recurly: Subscription Management Software & Recurring ...","link":"https://recurly.com/","position":6,"snippet":"Recurly is the best subscription management software and recurring billing platform on the market, compatible with leading ERP, CRM, payment gateways, ..."},{"title":"Billing and Subscriptions","link":"https://support.apple.com/billing","position":7,"snippet":"Manage your payment information. View and update your payment methods or update your billing information. Change, add, or remove a payment method. If you're ..."},{"title":"SAP Subscription Billing | Recurring Payment Management","link":"https://www.sap.com/products/financial-management/subscription-billing.html","position":8,"snippet":"Run simplified, automated billing and ordering processes designed for experience-centric consumers by using the SAP Subscription Billing solution."},{"title":"Recurring payments vs. subscription billing","link":"https://stripe.com/resources/more/recurring-payments-vs-subscription-billing","position":9,"snippet":"Apr 6, 2023 — Subscription billing is a payment model that allows businesses to charge recurring payments for access to products or services. Subscription ..."}],"peopleAlsoAsk":[{"question":"What is subscription billing?"},{"question":"How do I find my list of all my subscriptions?","link":"https://support.google.com/accounts/answer/7673989?hl=en&amp;co=GENIE.Platform%3DAndroid","title":"Find your purchases, reservations & subscriptions - Android - Google Help"},{"question":"What is subscription billing in Mycase?","link":"https://supportcenter.mycase.com/en/articles/9369989-subscription-billing#:~:text=Subscription%20Billing%20allows%20you%20to,for%20a%20recurring%20set%20fee.","title":"Subscription Billing - MyCase Help Center"},{"question":"How to bill a client for a subscription?","link":"https://toggl.com/blog/how-to-bill-clients","title":"How to Bill a Client for the First Time: A Step-by-Step Guide - Toggl Track"}],"relatedSearches":[{"query":"Subscription billing D365"},{"query":"Subscription billing software"},{"query":"Subscription billing cost"},{"query":"Subscription billing - Business Central"},{"query":"Subscription Billing SAP"},{"query":"Subscription billing Patreon"},{"query":"Subscription billing Apple"},{"query":"Payment and subscription Google"}]}

Retrieving content for item 4pjtky4don_961fb5d15f9bb584...

---
URL: https://www.google.com/search?q=paddle&gl=us&hl=en
Custom ID: 961fb5d15f9bb584

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"paddle"},"knowledgeGraph":{"title":"Paddle","description":"A paddle is a handheld tool with an elongated handle and a flat, widened end used as a lever to apply force onto the bladed end. It most commonly describes a completely handheld tool used to propel a human-powered watercraft by pushing water in a direction opposite to the direction of travel.","imageUrl":"https://www.amazon.com/Large-Bamboo-Paddle-Wooden-Airflow/dp/B0C9MH329T"},"organic":[{"title":"Paddle - Payments, tax and subscription management for ...","link":"https://www.paddle.com/","position":1,"snippet":"The Merchant of Record for digital products · 5,000+ SaaS, AI and app businesses use Paddle to solve all their payments, tax and compliance needs. Because the ...","sitelinks":[{"title":"Why has Paddle charged me?","link":"https://www.paddle.com/about/why-has-paddle-charged-me"},{"title":"Subscription Management","link":"https://www.paddle.com/billing/subscriptions"},{"title":"Pricing","link":"https://www.paddle.com/pricing"},{"title":"Get started","link":"https://www.paddle.com/get-started"},{"title":"About us","link":"https://www.paddle.com/about"}]},{"title":"PADDLE Definition & Meaning - Merriam-Webster","link":"https://www.merriam-webster.com/dictionary/paddle#:~:text=a,for%20stirring%2C%20mixing%2C%20or%20hitting","position":2},{"title":"PADDLE Definition & Meaning","link":"https://www.merriam-webster.com/dictionary/paddle","position":3,"snippet":"1. a : a usually wooden implement that has a long handle and a broad flattened blade and that is used to propel and steer a small craft (such as a canoe)"},{"title":"Squash, pickleball, padel, tennis: popular paddle sports, explained","link":"https://www.houstonchronicle.com/neighborhood/woodlands/article/squash-pickleball-padel-tennis-paddle-sports-trend-18444545.php#:~:text=Squash%2C%20pickleball%2C%20padel%2C%20tennis%3A%20popular%20paddle%20sports%2C%20explained","position":4},{"title":"Paddle","link":"https://en.wikipedia.org/wiki/Paddle","position":5,"snippet":"A paddle is a handheld tool with an elongated handle and a flat, widened end (the blade) used as a lever to apply force onto the bladed end."},{"title":"Roc Inflatable Stand Up Paddle Boards with Premium SUP ...","link":"https://www.amazon.com/Outdoors-Roc-Inflatable-Accessories-Non-Slip/dp/B0D3VS2QCJ","position":6,"snippet":"The adjustable paddle is perfect for either SUP or kayaking, and the waterproof dry bag is the perfect bonus--plus you can strap it to the front or back of the board for easy access."},{"title":"Bent Paddle Brewing Company: Home","link":"https://bentpaddlebrewing.com/","position":7,"snippet":"Visit the family friendly Bent Paddle Brewing taproom in the heart of Lincoln Park. Featuring craft beer, hemp bevs, live music + local eats!"},{"title":"paddle","link":"https://en.wiktionary.org/wiki/paddle","position":8,"snippet":"Verb · English 2-syllable words · English terms with IPA pronunciation · English terms with audio pronunciation · Rhymes:English/ædəl · Rhymes:English/ædəl/2 ..."}],"peopleAlsoAsk":[{"question":"What is a paddle?","link":"https://www.merriam-webster.com/dictionary/paddle#:~:text=a,for%20stirring%2C%20mixing%2C%20or%20hitting","title":"PADDLE Definition & Meaning - Merriam-Webster"},{"question":"What is paddle.com charging me for?","link":"https://www.paddle.com/about/why-has-paddle-charged-me#:~:text=If%20you're%20seeing%20a,software%20companies%20in%20our%20network.","title":"Why do I have a charge from Paddle? - FAQs"},{"question":"Is paddle like pickleball?","link":"https://www.ppatour.com/ppa-blog/padel-vs-pickleball/#:~:text=Pickleball%20and%20padel%20are%20both,game%20play%2C%20equipment%20and%20more.","title":"Padel vs Pickleball - PPA Tour"},{"question":"Is it padel or paddle?"}],"relatedSearches":[{"query":"Paddle tennis"},{"query":"Paddle sport"},{"query":"Paddle or padel"},{"query":"Paddle meaning in Hindi"},{"query":"paddle.com market limited"},{"query":"Boat Paddle"},{"query":"Paddle payment"},{"query":"Paddle board"}]}

Retrieving content for item 4pjtky4don_bb93e46ea1d317e7...

---
URL: https://www.google.com/search?q=merchant+of+record&gl=us&hl=en
Custom ID: bb93e46ea1d317e7

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"merchant of record"},"knowledgeGraph":{"description":"Aug 1, 2024 — A merchant of record (MoR) is a legal entity responsible for selling goods or services to an end customer. They manage all payments and take on ..."},"organic":[{"title":"Service (economics) - Wikipedia","link":"https://en.wikipedia.org/wiki/Service_(economics)","position":1},{"title":"What is a merchant of record (MoR) + why use one ... - Paddle","link":"https://www.paddle.com/blog/what-is-merchant-of-record#:~:text=A%20merchant%20of%20record%20(MoR)%20is%20a%20legal%20entity%20responsible,and%20honoring%20refunds%20and%20chargebacks.","position":2},{"title":"What is a merchant of record (MoR) + why use one ...","link":"https://www.paddle.com/blog/what-is-merchant-of-record","position":3,"snippet":"Aug 1, 2024 — A merchant of record (MoR) is a legal entity responsible for selling goods or services to an end customer. They manage all payments and take on ..."},{"title":"What Is a Merchant of Record? (And Why Should You Care?)","link":"https://fastspring.com/blog/what-is-a-merchant-of-record-and-why-you-should-care/","position":4,"snippet":"Sep 24, 2024 — A merchant of record (MoR) is the legal entity that sells goods or services to a customer. Companies can be their own MoR, but you can also ..."},{"title":"Merchant of Record vs. Seller of Record: Key Differences ...","link":"https://passportglobal.com/blog/merchant-of-record-vs-seller-of-record-key-differences-impacts-on-international-ecommerce/","position":5,"snippet":"Feb 19, 2025 — A Merchant of Record (MOR) assumes legal and financial responsibilities in transactions, acting as an intermediary for the brand. In contrast, a ..."},{"title":"Merchant of record payment services feedback : r/SaaS","link":"https://www.reddit.com/r/SaaS/comments/1bcwmyd/merchant_of_record_payment_services_feedback/","position":6,"snippet":"Merchant of Record is practically a reseller, hence you get to benefits (on top of your payments requirements) that a payment provider would not ..."},{"title":"What is a merchant of record?","link":"https://www.checkout.com/blog/what-is-a-merchant-of-record","position":7,"snippet":"Aug 10, 2023 — A merchant of record (MoR) is a professional service that takes responsibility for selling goods or services to an end consumer on behalf of a ..."},{"title":"Merchant of Record Vs Payment Gateway","link":"https://gappgroup.com/blog/merchant-of-record-vs-payment-gateway/","position":8,"snippet":"A Merchant of Record is a legal entity authorized to sell products or services to customers and process their credit and debit card transactions on behalf of ..."},{"title":"What is a Merchant of Record?","link":"https://gocardless.com/guides/posts/what-is-a-merchant-of-record/","position":9,"snippet":"A Merchant of Record is the term to describe a legal entity that handles all payments. In addition, it takes on the liability related to every transaction to an ..."}],"peopleAlsoAsk":[{"question":"What does being a merchant of record mean?","link":"https://www.paddle.com/blog/what-is-merchant-of-record#:~:text=A%20merchant%20of%20record%20(MoR)%20is%20a%20legal%20entity%20responsible,and%20honoring%20refunds%20and%20chargebacks.","title":"What is a merchant of record (MoR) + why use one ... - Paddle"},{"question":"What is the difference between merchant of record and seller of record?"},{"question":"Is Amazon a merchant of record?","link":"https://www.depositfix.com/blog/merchant-of-record#:~:text=Types%20of%20Merchant%20of%20Record&amp;text=It%20conducts%20transactions%20under%20its,an%20MoR%20for%20various%20sellers.","title":"Mastering Merchant of Record: A Comprehensive Business Guide"},{"question":"Is PayPal a merchant of record?"}],"relatedSearches":[{"query":"Merchant of record meaning"},{"query":"Merchant of record examples"},{"query":"Merchant of record Stripe"},{"query":"Merchant of record companies"},{"query":"Merchant of record VAT"},{"query":"Merchant of record Wiki"},{"query":"Merchant of record Shopify"},{"query":"Paddle merchant of record"}]}

Retrieving content for item 4pjtky4don_e7cd78a461046022...

---
URL: https://www.google.com/search?q=saas+payments&gl=us&hl=en
Custom ID: e7cd78a461046022

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"saas payments"},"knowledgeGraph":{"description":"Launch new plans and start accepting payments in minutes. Collect and store payment details including cards, ACH, and other popular payment methods. · Support ..."},"organic":[{"title":"Billing Platform for SaaS Businesses","link":"https://stripe.com/use-cases/saas","position":1,"snippet":"Launch new plans and start accepting payments in minutes. Collect and store payment details including cards, ACH, and other popular payment methods. · Support ..."},{"title":"Guidance for students from Scotland - GOV.UK","link":"https://www.gov.uk/guidance/guidance-for-students-from-scotland#:~:text=Student%20Loans%20Company%20(%20SLC%20)%20pays,do%20not%20pay%20student%20loans.","position":2},{"title":"What payment system do you use for your SaaS?","link":"https://www.reddit.com/r/SaaS/comments/1ejbn9i/what_payment_system_do_you_use_for_your_saas/","position":3,"snippet":"Try depositfix.com. It integrates a lot of possible payment systems, integrates with crm as well. Its great. Upvote 2. Downvote Reply reply"},{"title":"SaaS payment processing 101","link":"https://stripe.com/resources/more/challenges-of-saas-payment-processing","position":4,"snippet":"Mar 9, 2023 — SaaS payment processing refers to the way companies accept and process payments. While ecommerce sales consist of one-off online payments, SaaS ..."},{"title":"Moving Up(front) with Upfront SaaS Payments","link":"https://gsablogs.gsa.gov/technology/2024/07/25/moving-upfront-with-upfront-saas-payments/","position":5,"snippet":"Jul 25, 2024 — To offer the upfront payment option, vendors must submit a modification adding it to their schedule contract. We encourage vendors to offer SaaS ..."},{"title":"Understanding SaaS Payment Processing: Implementation ...","link":"https://staxpayments.com/blog/saas-payment-processing/","position":6,"snippet":"A SaaS payment processor is a service provider that focuses on providing the tools that SaaS companies need to manage payments and subscriptions accurately."},{"title":"Paddle - Payments, tax and subscription management for ...","link":"https://www.paddle.com/","position":7,"snippet":"The only complete billing solution for digital products. Payments, tax, subscription management and more, all handled for you. Discover Billing. SaaS billing ..."},{"title":"SaaS Spend Management Solution","link":"https://meshpayments.com/saas-spend-management/","position":8,"snippet":"Manage all your SaaS subscriptions from one platform, with actionable insights and controls at the right time to continuously optimize your spend."},{"title":"Top SaaS Payment Solutions for Streamlining Transactions","link":"https://wise.com/us/blog/saas-payment-solutions","position":9,"snippet":"Mar 10, 2025 — SaaS payment solutions are specialized payment platforms that enable software providers to efficiently manage and process recurring subscription ..."},{"title":"SaaS payments: everything SaaS businesses need to know","link":"https://www.checkout.com/blog/saas-payments","position":10,"snippet":"Sep 19, 2023 — SaaS payments are charged by subscription businesses on a recurring basis in exchange for access to a service."}],"peopleAlsoAsk":[{"question":"What are SaaS payments?","link":"https://www.gov.uk/guidance/guidance-for-students-from-scotland#:~:text=Student%20Loans%20Company%20(%20SLC%20)%20pays,do%20not%20pay%20student%20loans.","title":"Guidance for students from Scotland - GOV.UK"},{"question":"What are SaaS transactions?","link":"https://www.cognism.com/sales-saas#:~:text=SaaS%20sales%20is%20the%20process,their%20pain%20points%20or%20problems.","title":"What Is SaaS Sales? Everything You Need to Know in 2025 - Cognism"},{"question":"What does SaaS mean?","link":"https://azure.microsoft.com/en-us/resources/cloud-computing-dictionary/what-is-saas#:~:text=Software%20as%20a%20service%20definition,purchasing%20and%20installing%20them%20locally.","title":"What is Software as a Service (SaaS)? - Microsoft Azure"},{"question":"What date is the SaaS payment?","link":"https://www.saas.gov.uk/need-to-know/payments/loan-payments#:~:text=The%20SLC%20will%20issue%20a,released%20at%20the%20same%20time.","title":"Loan Payments - SAAS"}],"relatedSearches":[{"query":"Saas payments login"},{"query":"Saas payments reddit"},{"query":"SaaS billing"},{"query":"SaaS billing software"},{"query":"Best SaaS billing software"},{"query":"B2B SaaS billing software"},{"query":"Stripe SaaS billing"},{"query":"SaaS billing models"}]}

Since we passed the parser to retrieve the structured JSON and we are printing only that, the response contains:

  • json_content with structured search results including:
  • searchParameters: Information about the search query
  • knowledgeGraph: Detailed information about the search subject (when available)
  • organic: List of search results with title, link, position, and snippet
  • peopleAlsoAsk: Related questions that users commonly search for
  • relatedSearches: Suggested related search queries

If you don’t want the structured JSON but simply the markdown or html you can retrieve those from the retrieve endpoint.

Important Notes

If you want structured JSON you need to pass the specific parser to the API before making the requests. For example if you want to get the JSON from google search url you will pass this parser "parser": "@olostep/google-search" You can create your own parsers to retrieve the data you want from any page. Reach out to info@olostep.com to learn more.

Conclusion

The batch endpoint is useful if you need to get data from many URLs in a short period of time. You need to already have the list of urls you want to get the data from.

Common applications can be:

  • Price tracking services that monitor multiple e-commerce sites for price changes on products
  • Website monitoring tools that check for content updates across numerous pages
  • Data aggregation for concert organizers tracking ticket availability across multiple venues
  • Search engines gathering and indexing content from many websites simultaneously
  • News aggregators collecting articles from various publications
  • Real estate platforms monitoring property listings across multiple sites
  • Job boards aggregating openings from company career pages
  • Financial data services tracking stock prices and market information
  • Social media monitoring tools analyzing mentions across different platforms
  • Academic research gathering data from multiple sources for analysis

It’s better to use the batch endpoint if you want the content from 100 to 10k urls at a time. If you need to scrape less than 50 urls at a time we recommended using the scrape endpoint and submit the urls in parallel since it’s faster than the batch endpoint.

The Batch endpoint allows to process multiple URLs at the same time, making it easier to get content quickly from very large sets of urls. You can start a batch of up to 10k urls at a time and retrieve the content after 5-8 mins. You can start many batches in parallel to do up to 1 million requests in around 30 minutes.

How to use the Batch endpoint

To initiate a new batch, specify the items to be processed with their custom_id which is the unique identifier and url which is the url from which you want to get the content. You can also provide optional parameters such as the country and parser to be used for the batch.

In the example below, we will create a batch of 10 Google Search URLs and retrieve the structured JSON of the search results with the pre-built parser @olostep/google-search

import requests
import hashlib
import time

API_KEY = "<YOUR_API_KEY>"  # Replace with your actual API key
API_URL = "https://api.olostep.com/v1"


# Step 1: Utilities
def create_hash_id(url):
    return hashlib.sha256(url.encode()).hexdigest()[:16]


def compose_items_array():
    urls = [
        "https://www.google.com/search?q=ecommerce+platform&gl=us&hl=en",
        "https://www.google.com/search?q=payment+gateway&gl=us&hl=en",
        "https://www.google.com/search?q=stripe&gl=us&hl=en",
        "https://www.google.com/search?q=paddle&gl=us&hl=en",
        "https://www.google.com/search?q=merchant+of+record&gl=us&hl=en",
        "https://www.google.com/search?q=saas+payments&gl=us&hl=en",
        "https://www.google.com/search?q=digital+river&gl=us&hl=en",
        "https://www.google.com/search?q=subscription+billing&gl=us&hl=en",
        "https://www.google.com/search?q=online+payments&gl=us&hl=en",
        "https://www.google.com/search?q=braintree&gl=us&hl=en"
    ]

    # Add the parser configuration to each item
    items = []
    for url in urls:
        items.append({
            "custom_id": create_hash_id(url),
            "url": url,
        })

    return items


# Step 2: Start batch
def start_batch(items):
    payload = {
        "items": items,
        "country": "US",
        "parser": {"id": "@olostep/google-search"}
    }
    headers = {
        "Authorization": f"Bearer {API_KEY}",
        "Content-Type": "application/json"
    }
    response = requests.post(f"{API_URL}/batches", headers=headers, json=payload)
    response.raise_for_status()
    return response.json()["id"]


# Step 3: Wait for completion
def check_batch_status(batch_id):
    headers = {"Authorization": f"Bearer {API_KEY}"}
    response = requests.get(f"{API_URL}/batches/{batch_id}", headers=headers)
    response.raise_for_status()
    return response.json()["status"]


def wait_until_complete(batch_id):
    print("Waiting for batch to complete...")
    while True:
        status = check_batch_status(batch_id)
        print("Status:", status)
        if status == "completed":
            print("Batch completed!")
            return
        time.sleep(10)


# Step 4: Get items
def get_completed_items(batch_id):
    headers = {"Authorization": f"Bearer {API_KEY}"}
    response = requests.get(f"{API_URL}/batches/{batch_id}/items", headers=headers)
    response.raise_for_status()
    return response.json()["items"]


# Step 5: Retrieve content with format specified
def retrieve_content(retrieve_id):
    url = f"{API_URL}/retrieve"
    headers = {"Authorization": f"Bearer {API_KEY}"}
    params = {
        "retrieve_id": retrieve_id,
        "formats": ["markdown", "json"]
    }
    response = requests.get(url, headers=headers, params=params)
    response.raise_for_status()
    return response.json()


# Step 6: Run end-to-end flow
if __name__ == "__main__":
    print("Composing batch...")
    items = compose_items_array()

    print("Starting batch...")
    batch_id = start_batch(items)
    print("Batch ID:", batch_id)
    print(f"You can check the status of the batch at: {API_URL}/batches/{batch_id}?token={API_KEY}")

    wait_until_complete(batch_id)

    print("Fetching completed items...")
    completed_items = get_completed_items(batch_id)

    print("Retrieving content...")
    for item in completed_items:
        retrieve_id = item["retrieve_id"]
        print(f"\nRetrieving content for item {item['retrieve_id']}...")
        content = retrieve_content(retrieve_id)
        print(f"\n---\nURL: {item['url']}\nCustom ID: {item['custom_id']}\n")
        #print("Markdown:\n", content.get("markdown_content", "[No markdown found]"))
        print("JSON:\n", content.get("json_content", "[No JSON found]"))

        # If you want to see the parsed content specifically
        if "parsed_content" in content:
            print("\nParsed Content:")
            print(content["parsed_content"])

Response Format

When you run the above code, you will receive a response like the following


Waiting for batch to complete...
Status: in_progress
Status: completed
Batch completed!
Fetching completed items...
Retrieving content...

Retrieving content for item 4pjtky4don_86b1f04cec364903...

---
URL: https://www.google.com/search?q=ecommerce+platform&gl=us&hl=en
Custom ID: 86b1f04cec364903

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"ecommerce platform"},"knowledgeGraph":{"description":"Dec 6, 2024 — To help your business make the right decision, we compare top ecommerce platforms and provide key steps for finding the perfect solution."},"organic":[{"title":"9 Best Ecommerce Platforms of 2025 (Know Your Options)","link":"https://www.bigcommerce.com/articles/ecommerce/ecommerce-platforms/","position":1,"snippet":"Dec 6, 2024 — To help your business make the right decision, we compare top ecommerce platforms and provide key steps for finding the perfect solution."},{"title":"Top 10 Ecommerce Sites in India","link":"https://ecommerceguide.com/top/top-10-ecommerce-sites-in-india/","position":2},{"title":"11 Best Ecommerce Platforms for Your Business in 2025","link":"https://www.shopify.com/blog/best-ecommerce-platforms","position":3,"snippet":"The 11 best ecommerce platforms. Shopify; Wix; BigCommerce; Adobe Commerce; WooCommerce; Squarespace; Big Cartel; Square Online; Shift4Shop; Volusion; OpenCart ..."},{"title":"What is an Ecommerce Platform?","link":"https://www.salesforce.com/commerce/ecommerce-platform/","position":4,"snippet":"An ecommerce platform is software that helps businesses set up and run an online store. It handles product displays, payment processing, order management, and ..."},{"title":"10 Best E-Commerce Platforms Of 2025","link":"https://www.forbes.com/advisor/business/software/best-ecommerce-platform/","position":5,"snippet":"Dec 19, 2024 — 10 Best E-Commerce Platforms Of 2025 · Ecwid · Shift4Shop · Squarespace · BigCommerce · Web.com · Shopify · OpenCart · Big Cartel ..."},{"title":"#1 Ecommerce Shopping Cart & Online Store - Try Ecwid!","link":"https://www.ecwid.com/","position":6,"snippet":"Control everything from a single platform with centralized inventory, order management, and pricing. Get started. Sell everywhere Sell on ..."},{"title":"WooCommerce","link":"https://woocommerce.com/","position":7,"snippet":"WooCommerce empowers you to build, sell, and grow on your terms. Our WordPress-powered platform offers fully customizable ecommerce, for less."},{"title":"eCommerce Website Builder: Build An eCommerce Site","link":"https://www.wix.com/ecommerce/website","position":8,"snippet":"Wix eCommerce is your all-in-one eCommerce platform. Create a fully customizable free eCommerce website & upgrade to start selling everywhere."},{"title":"What E-Commerce platform do you use and why?","link":"https://www.reddit.com/r/ecommerce/comments/1cwo1uo/what_ecommerce_platform_do_you_use_and_why/","position":9,"snippet":"Shopify is hands down one of the best e-commerce platforms. Shopify has a user-friendly interface that simplifies store setup and management."}],"peopleAlsoAsk":[{"question":"What is an ecommerce platform?"},{"question":"What is the best ecommerce platform?"},{"question":"What are the top 5 e-commerce websites?","link":"https://ecommerceguide.com/top/top-10-ecommerce-sites-in-india/","title":"Top 10 Ecommerce Sites in India"},{"question":"What are the 3 types of e-commerce?"}],"relatedSearches":[{"query":"Ecommerce platform examples"},{"query":"e-commerce platforms list"},{"query":"Best ecommerce platform"},{"query":"Best ecommerce platform for beginners"},{"query":"Cheapest ecommerce platform"},{"query":"Best ecommerce platform for small business"},{"query":"Is Amazon an ecommerce platform"},{"query":"Best ecommerce platform for clothing"}]}

Retrieving content for item 4pjtky4don_5d0195299a727a71...

---
URL: https://www.google.com/search?q=payment+gateway&gl=us&hl=en
Custom ID: 5d0195299a727a71

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"payment gateway"},"knowledgeGraph":{"title":"Payment gateway","description":"A payment gateway is a merchant service provided by an e-commerce application service provider that authorizes credit card or direct payment processing for e-businesses, online retailers, bricks and clicks, or traditional brick and mortar.","imageUrl":"https://www.investopedia.com/terms/p/payment-gateway.asp"},"organic":[{"title":"What Is a Payment Gateway? How It Works and Example","link":"https://www.investopedia.com/terms/p/payment-gateway.asp","position":1,"snippet":"A payment gateway is the front-end technology that reads payment cards and sends customer information to the merchant acquiring bank for processing."},{"title":"What are payment gateways? - Stripe","link":"https://stripe.com/resources/more/payment-gateways-101#:~:text=A%20payment%20gateway%20is%20a,a%20secure%20and%20efficient%20manner.","position":2},{"title":"Online payment gateways bring these 5 benefits. - Binary Stream","link":"https://binarystream.com/online-payment-gateways-bring-these-5-benefits/","position":3},{"title":"What are payment gateways?","link":"https://stripe.com/resources/more/payment-gateways-101","position":4,"snippet":"Oct 16, 2023 — A payment gateway is a technology platform that acts as an intermediary in electronic financial transactions. It enables in-person and online ..."},{"title":"9 Best Payment Gateways Of 2025","link":"https://www.forbes.com/advisor/business/software/best-payment-gateways/","position":5,"snippet":"Jan 28, 2025 — 9 Best Payment Gateways Of 2025 · Helcim · PayPal · Shopify · Square · Payline · Clover · Authorize.net · Stripe; Stax. Table of Contents. Table ..."},{"title":"Payment processing: Accept payments anywhere | Authorize.net","link":"https://www.authorize.net/","position":6,"snippet":"Dec 16, 2024 — Accept credit cards, contactless payments, and eChecks in person and on the go. Contact us to learn more by calling 1-888-323-4289."},{"title":"Payment Gateways in 2025: Main Types + How They Work","link":"https://www.bigcommerce.com/articles/ecommerce/payment-gateways/","position":7,"snippet":"Payment gateways are a merchant service that processes credit card payments for both ecommerce sites and traditional brick-and-mortar stores. They can be ..."},{"title":"Payment Gateway, Merchant Services, B2B AR Automation ...","link":"https://paytrace.net/","position":8,"snippet":"Accept payments anywhere with our flexible payment platform. We make it simple and seamless for merchants to accept payments online, in person, and on the go."},{"title":"What Is A Payment Gateway And Why Do I Need One?","link":"https://corporate.freedompay.com/resources/blogs/what-is-a-payment-gateway-and-why-do-i-need-one","position":9,"snippet":"A payment gateway is a software program that sits between the merchant and their customer. It's often described as 'an electronic cash register for the virtual ..."},{"title":"What is a Payment Gateway and how does it work?","link":"https://gocardless.com/en-us/guides/posts/payment-gateways/","position":10,"snippet":"A payment gateway is a tool that securely validates your customer's credit card details, ensuring funds are available for you to get paid."}],"peopleAlsoAsk":[{"question":"What is a payment gateway?","link":"https://stripe.com/resources/more/payment-gateways-101#:~:text=A%20payment%20gateway%20is%20a,a%20secure%20and%20efficient%20manner.","title":"What are payment gateways? - Stripe"},{"question":"What's the best payment gateway?"},{"question":"Is PayPal a payment gateway?"},{"question":"Is Zelle a payment gateway?","link":"https://www.fiserv.com/en/lp/how-zelle-works.html#:~:text=Zelle%20is%20a%20P2P%20payments,credit%20union%20that%20offers%20Zelle.","title":"How Zelle Works - Fiserv"}],"relatedSearches":[{"query":"Payment gateway price"},{"query":"Payment gateway list"},{"query":"Payment gateway PayPal"},{"query":"Payment gateway login"},{"query":"Payment gateway vs payment processor"},{"query":"Types of payment gateway"},{"query":"Payment gateway for website"},{"query":"Payment gateway free"}]}

Retrieving content for item 4pjtky4don_f42462f1e5bb954d...

---
URL: https://www.google.com/search?q=braintree&gl=us&hl=en
Custom ID: f42462f1e5bb954d

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"braintree"},"knowledgeGraph":{"title":"Braintree","type":"Company","description":"PayPal Braintree is a global payment processing solution that delivers end-to-end checkout experiences for businesses, offering single-touch payments, mobile ...","imageUrl":"https://commons.wikimedia.org/wiki/File:Braintree_logo.svg","attributes":{"Founder":"Bryan Johnson","Parent organization":"PayPal","Founded":"October 22, 2007","Company location":"Chicago, Illinois","Headquarters":"Chicago, Illinois, United States","Number of employees":"500+ (2016)"}},"organic":[{"title":"Braintree | Enterprise Payment Solution","link":"https://www.paypal.com/us/braintree","position":1,"snippet":"PayPal Braintree is a global payment processing solution that delivers end-to-end checkout experiences for businesses, offering single-touch payments, mobile ..."},{"title":"Braintree vs. Paypal: Which is Better for Payment Processing - Tipalti","link":"https://tipalti.com/resources/learn/braintree-vs-paypal/#:~:text=Braintree%20offers%20more%20fraud%20protection,cryptocurrency%20buy%20and%20sell%20transactions.","position":2},{"title":"Braintree, MA | Official Website","link":"https://www.braintreema.gov/","position":3,"snippet":"Braintree Town Hall ... Town Hall is open Mon, Wed, Thur 8:30 AM to 4:30 PM, Tue 8:30 AM - 7:00 PM, Fri 8:30 AM - 1:00 PM."},{"title":"Braintree (company)","link":"https://en.wikipedia.org/wiki/Braintree_(company)","position":4,"snippet":"Braintree is a Chicago-based company that primarily deals in mobile and web payment systems for e-commerce companies. The company was acquired by PayPal on ..."},{"title":"Braintree Payment Gateway: Features, Pricing And Reviews","link":"https://staxpayments.com/blog/braintree-payment-gateway/#:~:text=Braintree%20offers%20transparent%20pricing%20with%20a%20fee%20of%202.59%25%20plus,2.9%25%20plus%20%240.30%20per%20transaction.","position":5},{"title":"Braintree Scientific","link":"https://www.braintreesci.com/","position":6,"snippet":"We are a women owned small business, dedicated to providing new product technology and supplies to advance medical milestones for all. You've seen our unique ..."},{"title":"HOME | Braintree Academy","link":"https://www.braintree4me.com/","position":7,"snippet":"Braintree Academy is a tuition-free, virtual public school program tailored to the unique needs of each student and family."},{"title":"Braintree, Massachusetts","link":"https://en.wikipedia.org/wiki/Braintree,_Massachusetts","position":8,"snippet":"Braintree is a municipality in Norfolk County, Massachusetts, United States. It is officially known as a town, but Braintree is a city with a mayor-council ..."},{"title":"BrainTree Nutrition Collection | Brain Health Supplements","link":"https://www.braintreenutrition.com/collections/all?srsltid=AfmBOor3eehM1T3xOqtn2i1wApxaWrFtRMoOCp6en_4X24_JXoYoWptj","position":9,"snippet":"We offer the finest nutritional products for cognitive enhancement, brain health and anti-aging. Fortify long-lasting brain health and unrivaled cognitive power ..."},{"title":"Braintree Gateway Login","link":"https://www.braintreegateway.com/login","position":10,"snippet":"A username can be either: A unique identifier designated by you at signup (e.g. yourusername100); The email you signed up with (e.g. example@email.com)."},{"title":"PayPal Braintree Fees & Pricing","link":"https://www.paypal.com/us/enterprise/paypal-braintree-fees","position":11,"snippet":"Custom flat rates, interchange plus pricing, and discounted rates are available for established businesses based on business model and processing volume."}],"peopleAlsoAsk":[{"question":"What is Braintree used for?"},{"question":"How much did Bryan Johnson sell Braintree for?"},{"question":"What is the difference between PayPal and Braintree?","link":"https://tipalti.com/resources/learn/braintree-vs-paypal/#:~:text=Braintree%20offers%20more%20fraud%20protection,cryptocurrency%20buy%20and%20sell%20transactions.","title":"Braintree vs. Paypal: Which is Better for Payment Processing - Tipalti"},{"question":"Is Braintree the same as Venmo?","link":"https://en.wikipedia.org/wiki/Braintree_(company)#:~:text=In%202012%2C%20Braintree%20acquired%20Venmo%20for%20%2426.2%20million.","title":"Braintree (company) - Wikipedia"}],"relatedSearches":[{"query":"Braintree pricing"},{"query":"Braintree login"},{"query":"Braintree PayPal"},{"query":"Braintree payments"},{"query":"Braintree school"},{"query":"Braintree company"},{"query":"Braintree sandbox"},{"query":"Braintree city"}]}

Retrieving content for item 4pjtky4don_256e5f8ec1074fca...

---
URL: https://www.google.com/search?q=digital+river&gl=us&hl=en
Custom ID: 256e5f8ec1074fca

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"digital river"},"knowledgeGraph":{"title":"Digital River","type":"E-commerce company","description":"Digital River, Inc. was a privately held company headquartered in Minnetonka, Minnesota that provides global e-commerce, payments and marketing services.","imageUrl":"https://www.digitalriver.com/","attributes":{"Headquarters":"Minnetonka, MN","CEO":"Adam Coyle (Jul 10, 2018–)","Founder":"Joel A. Ronning","Founded":"February 1994","Number of employees":"122 (2025)","Traded as":"Nasdaq: DRIV (1998–2015)"}},"organic":[{"title":"Digital River","link":"https://en.wikipedia.org/wiki/Digital_River","position":1,"snippet":"Digital River, Inc. was a privately held company headquartered in Minnetonka, Minnesota that provides global e-commerce, payments and marketing services."},{"title":"US paytech Digital River reportedly shutting down","link":"https://www.fintechfutures.com/2025/02/us-paytech-digital-river-reportedly-shutting-down/#:~:text=Founded%20in%201994%2C%20Digital%20River,%2C%20Salesforce%2C%20and%20American%20Express.","position":2},{"title":"US paytech Digital River reportedly shutting down","link":"https://www.fintechfutures.com/digital-payments/us-paytech-digital-river-reportedly-shutting-down","position":3,"snippet":"Feb 11, 2025 — US-based payments firm Digital River is reportedly winding down its operations, according to local media outlet The Minnesota Star Tribune."},{"title":"Minnetonka-based E-Commerce Firm Digital River to Shut ...","link":"https://tcbmag.com/minnetonka-based-e-commerce-firm-digital-river-to-shut-down/","position":4,"snippet":"Jan 28, 2025 — Minnetonka-based e-commerce firm Digital River is laying off 122 employees locally and winding down global operations elsewhere."},{"title":"Renew Digital River subscriptions directly with Adobe","link":"https://helpx.adobe.com/x-productkb/policy-pricing/digital-river-deprecation-adobe.html#:~:text=Why%20can't%20I%20get%20a%20refund%20for%20my%20purchase,any%20inconvenience%20this%20may%20cause.","position":5},{"title":"I have a \"Digital River\" transaction on my bank statement ...","link":"https://www.reddit.com/r/personalfinance/comments/daj103/i_have_a_digital_river_transaction_on_my_bank/","position":6,"snippet":"Digital River is a legitimate e-commerce vendor. They help businesses setup their online stores. Have you made any online purchases recently?"},{"title":"Digital River (@DigitalRiverInc) / X","link":"https://x.com/digitalriverinc?lang=en","position":7,"snippet":"Jul 2, 2024 — The ultimate ecommerce accelerator for global growth. Fast, easy, risk-free expansion into 240+ destinations. Accelerate. Simplify. Optimize."},{"title":"Digital River","link":"https://www.linkedin.com/company/digital-river","position":8,"snippet":"We're proactive partners, providing API-based Cross-Border, Order Management and Ecommerce services to leading enterprise brands.","meta":"68.9K+ followers"},{"title":"Digital River Insolvency: A Guide for Affected Software ...","link":"https://freemius.com/blog/digital-river-mycommerce-shutdown-guide/","position":9,"snippet":"Jan 31, 2025 — Digital River abruptly laid off over 100 employees and filed for insolvency, leaving software creators in the lurch, unable to access their hard-earned revenue."},{"title":"Digital River cuts staff and will close headquarters","link":"https://www.digitalcommerce360.com/2025/01/29/digital-river-cuts-staff-will-shut-down-headquarters/","position":10,"snippet":"Jan 29, 2025 — The company will close its Minnesota headquarters by the end of March, impacting 122 employees, including remote workers nationwide."},{"title":"Connecting with Digital River","link":"https://support.bigcommerce.com/s/article/Connecting-with-Digital-River","position":11,"snippet":"Digital River is a global online payments platform engineered to maximize conversions and grow revenue. Digital River partners with the world's leading ..."},{"title":"Who is Digital River Ireland, Ltd.","link":"https://www.paypal-community.com/t5/Security-and-Fraud/Who-is-Digital-River-Ireland-Ltd/td-p/3055369","position":12,"snippet":"Apr 17, 2023 — Digital river is an ecommerce payment company. They don't fraudulently take your money. They partner with companies like Samsung, Microsoft, ..."}],"peopleAlsoAsk":[{"question":"Is Digital River still in business?"},{"question":"What is the Digital River?","link":"https://www.fintechfutures.com/2025/02/us-paytech-digital-river-reportedly-shutting-down/#:~:text=Founded%20in%201994%2C%20Digital%20River,%2C%20Salesforce%2C%20and%20American%20Express.","title":"US paytech Digital River reportedly shutting down"},{"question":"How do I stop my Digital River subscription?","link":"https://emma-app.com/how-to-cancel-digital-river#:~:text=To%20cancel%20a%20Digital%20River,contact%20their%20customer%20service%20there.","title":"How To Cancel Digital River - Emma app"},{"question":"What is happening at Digital River?","link":"https://gappgroup.com/blog/digital-river-is-shutting-down-heres-how-gapp-group-can-seamlessly-support-its-customers/#:~:text=The%20eCommerce%20industry%20was%20recently,before%20their%20operations%20are%20disrupted.","title":"Digital River Is Shutting Down – Here's How Gapp Group Can ..."}],"relatedSearches":[{"query":"Digital River payment"},{"query":"Digital River charge on credit card"},{"query":"Digital River subscription"},{"query":"Digital river complaints"},{"query":"Digital river app"},{"query":"Digital River Adobe"},{"query":"Digital River news"},{"query":"Digital River NVIDIA"}]}

Retrieving content for item 4pjtky4don_625d3a44aeb9123b...

---
URL: https://www.google.com/search?q=online+payments&gl=us&hl=en
Custom ID: 625d3a44aeb9123b

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"online payments"},"knowledgeGraph":{"description":"Pay your income tax, property tax, college tuition, utility and other bills online with a credit card, debit card or other convenient option."},"organic":[{"title":"ACI Payments, Inc. - Pay Taxes, Utility Bills, Tuition & More ...","link":"https://www.officialpayments.com/","position":1,"snippet":"Pay your income tax, property tax, college tuition, utility and other bills online with a credit card, debit card or other convenient option."},{"title":"The 6 best online payment processing services in 2025 - Zapier","link":"https://zapier.com/blog/best-payment-gateways/","position":2},{"title":"Pay, Send and Save Money with PayPal | PayPal US","link":"https://www.paypal.com/","position":3,"snippet":"Tap to pay safely in stores with the PayPal Debit Card and earn rewards online with PayPal checkout. Get even more cash back on the brands you love."},{"title":"Online Payments Made Simple | Pay.com","link":"https://pay.com/","position":4,"snippet":"Pay.com lets you easily accept online payments and grow your revenue. Start accepting credit and debit cards, digital wallets, and other payment methods."},{"title":"Payments | Internal Revenue Service","link":"https://www.irs.gov/payments","position":5,"snippet":"View amount due, payment plan details, payment history and scheduled payments; Pay separate assessment payments. Pay in online account. Business Tax Account."},{"title":"Seamlessly Pay Online, Pay In Stores or Send Money","link":"https://pay.google.com/about/","position":6,"snippet":"Google Pay is a quick, easy, and secure way to pay online, in stores or send money to friends and family. Pay the Google way."},{"title":"Stripe | Financial Infrastructure to Grow Your Revenue","link":"https://stripe.com/","position":7,"snippet":"Stripe powers online and in-person payment processing and financial solutions for businesses of all sizes. Accept payments, send payouts, and automate ..."},{"title":"Collecting online payments: How It works","link":"https://stripe.com/guides/introduction-to-online-payments","position":8,"snippet":"This guide offers a high-level overview of online payments and covers nuances based on different business models. Learn more."},{"title":"The Best Online Payment Service Providers in 2023","link":"https://www.wildapricot.com/blog/online-payment-services","position":9,"snippet":"Jul 14, 2023 — The Top 11 Best Online Payment Systems For Your Organization · 1. WildApricot Payments · 2. Stripe · 3. Apple Pay · 4. Dwolla · 5. Due · 6."},{"title":"Pay.gov - Home","link":"https://www.pay.gov/","position":10,"snippet":"Pay an overdue debt to the Bureau of the Fiscal Service. Do you want to make a payment toward a federal non-tax debt (not an IRS tax debt or student loan debt)?."}],"peopleAlsoAsk":[{"question":"Which site is best for online payments?","link":"https://zapier.com/blog/best-payment-gateways/","title":"The 6 best online payment processing services in 2025 - Zapier"},{"question":"Which is best for online payments?","link":"https://www.dsgpay.com/blog/digital-payment-services-in-india/","title":"10 Best Digital Payment Services in India 2024: Pros and Cons - DSGPay"},{"question":"What is meant by online payment?","link":"https://www.pinelabs.com/blog/online-payments-and-its-types-methods-and-meaning#:~:text=Online%20payment%20allows%20you%20to,net%20banking%2C%20and%20digital%20wallets.","title":"What is Online Payment? Types, Modes, Methods, Meaning"},{"question":"What is the best way to pay online?"}],"relatedSearches":[{"query":"Free online payments"},{"query":"Online payments credit card"},{"query":"IRS payment online"},{"query":"Online payments app"},{"query":"ACI Payments online"},{"query":"Pay estimated taxes online"},{"query":"ACI pay online Customer Service"},{"query":"PayPal"}]}

Retrieving content for item 4pjtky4don_bd045d49c210b22a...

---
URL: https://www.google.com/search?q=stripe&gl=us&hl=en
Custom ID: bd045d49c210b22a

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"stripe"},"knowledgeGraph":{"title":"Stripe, Inc.","type":"Financial services company","description":"Reduce costs, grow revenue, and run your business more efficiently on a fully integrated platform. Use Stripe to handle all of your payments-related needs, ...","website":"http://stripe.com/","imageUrl":"http://t3.gstatic.com/images?q=tbn:ANd9GcSJHbnfk81kA_5mIj81yhRy3R2LRx3S11OyMjC68QeONsOp5DXx","attributes":{"Founders":"Patrick Collison, John Collison","Headquarters":"Dublin, Ireland","CEO":"Patrick Collison (2010–)","Revenue":"14.4 billion USD (2022)","Founded":"2010, San Francisco, CA","Number of employees":"8,500 (2025)"}},"organic":[{"title":"Stripe | Financial Infrastructure to Grow Your Revenue","link":"https://stripe.com/","position":1,"snippet":"Reduce costs, grow revenue, and run your business more efficiently on a fully integrated platform. Use Stripe to handle all of your payments-related needs, ...","sitelinks":[{"title":"Login","link":"https://dashboard.stripe.com/login"},{"title":"Create your Stripe account","link":"https://dashboard.stripe.com/register"},{"title":"Jobs","link":"https://stripe.com/jobs"},{"title":"Pricing & Fees","link":"https://stripe.com/pricing"},{"title":"Support","link":"https://support.stripe.com/"}]},{"title":"What Is Stripe, and How Does It Work to Accept Payments? - NerdWallet","link":"https://www.nerdwallet.com/article/small-business/what-is-stripe#:~:text=Stripe%20is%20a%20payment%20processing,platform's%20developer%20tools%20and%20customizability.","position":2},{"title":"Stripe - X","link":"https://x.com/stripe?lang=en","position":3,"snippet":"Stripe is a global technology company that builds economic infrastructure for the internet. Help: @stripesupport. Read: @stripepress. Status: @stripestatus."},{"title":"Stripe, Inc.","link":"https://en.wikipedia.org/wiki/Stripe,_Inc.","position":4,"snippet":"Stripe is the largest privately-owned fintech company with a valuation of about $91 billion and over $1.4 trillion in payment volume processed in 2024."},{"title":"Stripe","link":"https://www.linkedin.com/company/stripe","position":5,"snippet":"Stripe is a financial infrastructure platform for businesses. Millions of companies—from the world's largest enterprises to the most ...","meta":"1M+ followers"}],"peopleAlsoAsk":[{"question":"What does Stripe exactly do?","link":"https://www.nerdwallet.com/article/small-business/what-is-stripe#:~:text=Stripe%20is%20a%20payment%20processing,platform's%20developer%20tools%20and%20customizability.","title":"What Is Stripe, and How Does It Work to Accept Payments? - NerdWallet"},{"question":"Is Stripe owned by Elon Musk?","link":"https://en.wikipedia.org/wiki/Stripe,_Inc.#:~:text=In%202011%20the%20company%20received,Andreessen%20Horowitz%2C%20and%20SV%20Angel.","title":"Stripe, Inc. - Wikipedia"},{"question":"What is Stripe and is it legit?","link":"https://www.acodei.com/blog/is-stripe-safe-and-secure#:~:text=Stripe%20is%20a%20highly%20secure%20payment%20platform%20trusted%20by%20businesses%20worldwide.","title":"Is Stripe Safe and Secure? - Acodei Blog"},{"question":"How much is the Stripe fee for $100?"}],"relatedSearches":[{"query":"Stripe fees"},{"query":"Stripe login"},{"query":"Stripe careers"},{"query":"Stripe Express"},{"query":"Stripe sign up"},{"query":"Stripe Dashboard"},{"query":"Stripe payment"},{"query":"Stripe logo"}]}

Retrieving content for item 4pjtky4don_228d8979b098d94d...

---
URL: https://www.google.com/search?q=subscription+billing&gl=us&hl=en
Custom ID: 228d8979b098d94d

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"subscription billing"},"knowledgeGraph":{"description":"Stripe Billing lets you bill and manage customers however you want—from simple recurring billing to usage-based billing and sales-negotiated contracts."},"organic":[{"title":"Stripe Billing | Recurring Payments & Subscription ...","link":"https://stripe.com/billing","position":1,"snippet":"Stripe Billing lets you bill and manage customers however you want—from simple recurring billing to usage-based billing and sales-negotiated contracts."},{"title":"Find your purchases, reservations & subscriptions - Android - Google Help","link":"https://support.google.com/accounts/answer/7673989?hl=en&co=GENIE.Platform%3DAndroid","position":2},{"title":"Subscription billing overview - Finance | Dynamics 365","link":"https://learn.microsoft.com/en-us/dynamics365/finance/accounts-receivable/subscription-billing-summary","position":3,"snippet":"Mar 13, 2024 — Subscription billing enables organizations to manage subscription revenue opportunities and recurring billing through billing schedules."},{"title":"What is Subscription Billing?","link":"https://dealhub.io/glossary/subscription-billing/","position":4,"snippet":"Sep 8, 2024 — Subscription billing is a type of recurring billing in which customers are charged a set amount at regular intervals for a service or product."},{"title":"What is Subscription Billing? A Guide for SaaS Businesses","link":"https://www.younium.com/blog/what-is-subscription-billing","position":5,"snippet":"Subscription billing involves collecting recurring payments from customers automatically at set intervals. With this model, you require your subscribers to sign ..."},{"title":"Recurly: Subscription Management Software & Recurring ...","link":"https://recurly.com/","position":6,"snippet":"Recurly is the best subscription management software and recurring billing platform on the market, compatible with leading ERP, CRM, payment gateways, ..."},{"title":"Billing and Subscriptions","link":"https://support.apple.com/billing","position":7,"snippet":"Manage your payment information. View and update your payment methods or update your billing information. Change, add, or remove a payment method. If you're ..."},{"title":"SAP Subscription Billing | Recurring Payment Management","link":"https://www.sap.com/products/financial-management/subscription-billing.html","position":8,"snippet":"Run simplified, automated billing and ordering processes designed for experience-centric consumers by using the SAP Subscription Billing solution."},{"title":"Recurring payments vs. subscription billing","link":"https://stripe.com/resources/more/recurring-payments-vs-subscription-billing","position":9,"snippet":"Apr 6, 2023 — Subscription billing is a payment model that allows businesses to charge recurring payments for access to products or services. Subscription ..."}],"peopleAlsoAsk":[{"question":"What is subscription billing?"},{"question":"How do I find my list of all my subscriptions?","link":"https://support.google.com/accounts/answer/7673989?hl=en&amp;co=GENIE.Platform%3DAndroid","title":"Find your purchases, reservations & subscriptions - Android - Google Help"},{"question":"What is subscription billing in Mycase?","link":"https://supportcenter.mycase.com/en/articles/9369989-subscription-billing#:~:text=Subscription%20Billing%20allows%20you%20to,for%20a%20recurring%20set%20fee.","title":"Subscription Billing - MyCase Help Center"},{"question":"How to bill a client for a subscription?","link":"https://toggl.com/blog/how-to-bill-clients","title":"How to Bill a Client for the First Time: A Step-by-Step Guide - Toggl Track"}],"relatedSearches":[{"query":"Subscription billing D365"},{"query":"Subscription billing software"},{"query":"Subscription billing cost"},{"query":"Subscription billing - Business Central"},{"query":"Subscription Billing SAP"},{"query":"Subscription billing Patreon"},{"query":"Subscription billing Apple"},{"query":"Payment and subscription Google"}]}

Retrieving content for item 4pjtky4don_961fb5d15f9bb584...

---
URL: https://www.google.com/search?q=paddle&gl=us&hl=en
Custom ID: 961fb5d15f9bb584

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"paddle"},"knowledgeGraph":{"title":"Paddle","description":"A paddle is a handheld tool with an elongated handle and a flat, widened end used as a lever to apply force onto the bladed end. It most commonly describes a completely handheld tool used to propel a human-powered watercraft by pushing water in a direction opposite to the direction of travel.","imageUrl":"https://www.amazon.com/Large-Bamboo-Paddle-Wooden-Airflow/dp/B0C9MH329T"},"organic":[{"title":"Paddle - Payments, tax and subscription management for ...","link":"https://www.paddle.com/","position":1,"snippet":"The Merchant of Record for digital products · 5,000+ SaaS, AI and app businesses use Paddle to solve all their payments, tax and compliance needs. Because the ...","sitelinks":[{"title":"Why has Paddle charged me?","link":"https://www.paddle.com/about/why-has-paddle-charged-me"},{"title":"Subscription Management","link":"https://www.paddle.com/billing/subscriptions"},{"title":"Pricing","link":"https://www.paddle.com/pricing"},{"title":"Get started","link":"https://www.paddle.com/get-started"},{"title":"About us","link":"https://www.paddle.com/about"}]},{"title":"PADDLE Definition & Meaning - Merriam-Webster","link":"https://www.merriam-webster.com/dictionary/paddle#:~:text=a,for%20stirring%2C%20mixing%2C%20or%20hitting","position":2},{"title":"PADDLE Definition & Meaning","link":"https://www.merriam-webster.com/dictionary/paddle","position":3,"snippet":"1. a : a usually wooden implement that has a long handle and a broad flattened blade and that is used to propel and steer a small craft (such as a canoe)"},{"title":"Squash, pickleball, padel, tennis: popular paddle sports, explained","link":"https://www.houstonchronicle.com/neighborhood/woodlands/article/squash-pickleball-padel-tennis-paddle-sports-trend-18444545.php#:~:text=Squash%2C%20pickleball%2C%20padel%2C%20tennis%3A%20popular%20paddle%20sports%2C%20explained","position":4},{"title":"Paddle","link":"https://en.wikipedia.org/wiki/Paddle","position":5,"snippet":"A paddle is a handheld tool with an elongated handle and a flat, widened end (the blade) used as a lever to apply force onto the bladed end."},{"title":"Roc Inflatable Stand Up Paddle Boards with Premium SUP ...","link":"https://www.amazon.com/Outdoors-Roc-Inflatable-Accessories-Non-Slip/dp/B0D3VS2QCJ","position":6,"snippet":"The adjustable paddle is perfect for either SUP or kayaking, and the waterproof dry bag is the perfect bonus--plus you can strap it to the front or back of the board for easy access."},{"title":"Bent Paddle Brewing Company: Home","link":"https://bentpaddlebrewing.com/","position":7,"snippet":"Visit the family friendly Bent Paddle Brewing taproom in the heart of Lincoln Park. Featuring craft beer, hemp bevs, live music + local eats!"},{"title":"paddle","link":"https://en.wiktionary.org/wiki/paddle","position":8,"snippet":"Verb · English 2-syllable words · English terms with IPA pronunciation · English terms with audio pronunciation · Rhymes:English/ædəl · Rhymes:English/ædəl/2 ..."}],"peopleAlsoAsk":[{"question":"What is a paddle?","link":"https://www.merriam-webster.com/dictionary/paddle#:~:text=a,for%20stirring%2C%20mixing%2C%20or%20hitting","title":"PADDLE Definition & Meaning - Merriam-Webster"},{"question":"What is paddle.com charging me for?","link":"https://www.paddle.com/about/why-has-paddle-charged-me#:~:text=If%20you're%20seeing%20a,software%20companies%20in%20our%20network.","title":"Why do I have a charge from Paddle? - FAQs"},{"question":"Is paddle like pickleball?","link":"https://www.ppatour.com/ppa-blog/padel-vs-pickleball/#:~:text=Pickleball%20and%20padel%20are%20both,game%20play%2C%20equipment%20and%20more.","title":"Padel vs Pickleball - PPA Tour"},{"question":"Is it padel or paddle?"}],"relatedSearches":[{"query":"Paddle tennis"},{"query":"Paddle sport"},{"query":"Paddle or padel"},{"query":"Paddle meaning in Hindi"},{"query":"paddle.com market limited"},{"query":"Boat Paddle"},{"query":"Paddle payment"},{"query":"Paddle board"}]}

Retrieving content for item 4pjtky4don_bb93e46ea1d317e7...

---
URL: https://www.google.com/search?q=merchant+of+record&gl=us&hl=en
Custom ID: bb93e46ea1d317e7

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"merchant of record"},"knowledgeGraph":{"description":"Aug 1, 2024 — A merchant of record (MoR) is a legal entity responsible for selling goods or services to an end customer. They manage all payments and take on ..."},"organic":[{"title":"Service (economics) - Wikipedia","link":"https://en.wikipedia.org/wiki/Service_(economics)","position":1},{"title":"What is a merchant of record (MoR) + why use one ... - Paddle","link":"https://www.paddle.com/blog/what-is-merchant-of-record#:~:text=A%20merchant%20of%20record%20(MoR)%20is%20a%20legal%20entity%20responsible,and%20honoring%20refunds%20and%20chargebacks.","position":2},{"title":"What is a merchant of record (MoR) + why use one ...","link":"https://www.paddle.com/blog/what-is-merchant-of-record","position":3,"snippet":"Aug 1, 2024 — A merchant of record (MoR) is a legal entity responsible for selling goods or services to an end customer. They manage all payments and take on ..."},{"title":"What Is a Merchant of Record? (And Why Should You Care?)","link":"https://fastspring.com/blog/what-is-a-merchant-of-record-and-why-you-should-care/","position":4,"snippet":"Sep 24, 2024 — A merchant of record (MoR) is the legal entity that sells goods or services to a customer. Companies can be their own MoR, but you can also ..."},{"title":"Merchant of Record vs. Seller of Record: Key Differences ...","link":"https://passportglobal.com/blog/merchant-of-record-vs-seller-of-record-key-differences-impacts-on-international-ecommerce/","position":5,"snippet":"Feb 19, 2025 — A Merchant of Record (MOR) assumes legal and financial responsibilities in transactions, acting as an intermediary for the brand. In contrast, a ..."},{"title":"Merchant of record payment services feedback : r/SaaS","link":"https://www.reddit.com/r/SaaS/comments/1bcwmyd/merchant_of_record_payment_services_feedback/","position":6,"snippet":"Merchant of Record is practically a reseller, hence you get to benefits (on top of your payments requirements) that a payment provider would not ..."},{"title":"What is a merchant of record?","link":"https://www.checkout.com/blog/what-is-a-merchant-of-record","position":7,"snippet":"Aug 10, 2023 — A merchant of record (MoR) is a professional service that takes responsibility for selling goods or services to an end consumer on behalf of a ..."},{"title":"Merchant of Record Vs Payment Gateway","link":"https://gappgroup.com/blog/merchant-of-record-vs-payment-gateway/","position":8,"snippet":"A Merchant of Record is a legal entity authorized to sell products or services to customers and process their credit and debit card transactions on behalf of ..."},{"title":"What is a Merchant of Record?","link":"https://gocardless.com/guides/posts/what-is-a-merchant-of-record/","position":9,"snippet":"A Merchant of Record is the term to describe a legal entity that handles all payments. In addition, it takes on the liability related to every transaction to an ..."}],"peopleAlsoAsk":[{"question":"What does being a merchant of record mean?","link":"https://www.paddle.com/blog/what-is-merchant-of-record#:~:text=A%20merchant%20of%20record%20(MoR)%20is%20a%20legal%20entity%20responsible,and%20honoring%20refunds%20and%20chargebacks.","title":"What is a merchant of record (MoR) + why use one ... - Paddle"},{"question":"What is the difference between merchant of record and seller of record?"},{"question":"Is Amazon a merchant of record?","link":"https://www.depositfix.com/blog/merchant-of-record#:~:text=Types%20of%20Merchant%20of%20Record&amp;text=It%20conducts%20transactions%20under%20its,an%20MoR%20for%20various%20sellers.","title":"Mastering Merchant of Record: A Comprehensive Business Guide"},{"question":"Is PayPal a merchant of record?"}],"relatedSearches":[{"query":"Merchant of record meaning"},{"query":"Merchant of record examples"},{"query":"Merchant of record Stripe"},{"query":"Merchant of record companies"},{"query":"Merchant of record VAT"},{"query":"Merchant of record Wiki"},{"query":"Merchant of record Shopify"},{"query":"Paddle merchant of record"}]}

Retrieving content for item 4pjtky4don_e7cd78a461046022...

---
URL: https://www.google.com/search?q=saas+payments&gl=us&hl=en
Custom ID: e7cd78a461046022

JSON:
 {"searchParameters":{"type":"search","engine":"google","q":"saas payments"},"knowledgeGraph":{"description":"Launch new plans and start accepting payments in minutes. Collect and store payment details including cards, ACH, and other popular payment methods. · Support ..."},"organic":[{"title":"Billing Platform for SaaS Businesses","link":"https://stripe.com/use-cases/saas","position":1,"snippet":"Launch new plans and start accepting payments in minutes. Collect and store payment details including cards, ACH, and other popular payment methods. · Support ..."},{"title":"Guidance for students from Scotland - GOV.UK","link":"https://www.gov.uk/guidance/guidance-for-students-from-scotland#:~:text=Student%20Loans%20Company%20(%20SLC%20)%20pays,do%20not%20pay%20student%20loans.","position":2},{"title":"What payment system do you use for your SaaS?","link":"https://www.reddit.com/r/SaaS/comments/1ejbn9i/what_payment_system_do_you_use_for_your_saas/","position":3,"snippet":"Try depositfix.com. It integrates a lot of possible payment systems, integrates with crm as well. Its great. Upvote 2. Downvote Reply reply"},{"title":"SaaS payment processing 101","link":"https://stripe.com/resources/more/challenges-of-saas-payment-processing","position":4,"snippet":"Mar 9, 2023 — SaaS payment processing refers to the way companies accept and process payments. While ecommerce sales consist of one-off online payments, SaaS ..."},{"title":"Moving Up(front) with Upfront SaaS Payments","link":"https://gsablogs.gsa.gov/technology/2024/07/25/moving-upfront-with-upfront-saas-payments/","position":5,"snippet":"Jul 25, 2024 — To offer the upfront payment option, vendors must submit a modification adding it to their schedule contract. We encourage vendors to offer SaaS ..."},{"title":"Understanding SaaS Payment Processing: Implementation ...","link":"https://staxpayments.com/blog/saas-payment-processing/","position":6,"snippet":"A SaaS payment processor is a service provider that focuses on providing the tools that SaaS companies need to manage payments and subscriptions accurately."},{"title":"Paddle - Payments, tax and subscription management for ...","link":"https://www.paddle.com/","position":7,"snippet":"The only complete billing solution for digital products. Payments, tax, subscription management and more, all handled for you. Discover Billing. SaaS billing ..."},{"title":"SaaS Spend Management Solution","link":"https://meshpayments.com/saas-spend-management/","position":8,"snippet":"Manage all your SaaS subscriptions from one platform, with actionable insights and controls at the right time to continuously optimize your spend."},{"title":"Top SaaS Payment Solutions for Streamlining Transactions","link":"https://wise.com/us/blog/saas-payment-solutions","position":9,"snippet":"Mar 10, 2025 — SaaS payment solutions are specialized payment platforms that enable software providers to efficiently manage and process recurring subscription ..."},{"title":"SaaS payments: everything SaaS businesses need to know","link":"https://www.checkout.com/blog/saas-payments","position":10,"snippet":"Sep 19, 2023 — SaaS payments are charged by subscription businesses on a recurring basis in exchange for access to a service."}],"peopleAlsoAsk":[{"question":"What are SaaS payments?","link":"https://www.gov.uk/guidance/guidance-for-students-from-scotland#:~:text=Student%20Loans%20Company%20(%20SLC%20)%20pays,do%20not%20pay%20student%20loans.","title":"Guidance for students from Scotland - GOV.UK"},{"question":"What are SaaS transactions?","link":"https://www.cognism.com/sales-saas#:~:text=SaaS%20sales%20is%20the%20process,their%20pain%20points%20or%20problems.","title":"What Is SaaS Sales? Everything You Need to Know in 2025 - Cognism"},{"question":"What does SaaS mean?","link":"https://azure.microsoft.com/en-us/resources/cloud-computing-dictionary/what-is-saas#:~:text=Software%20as%20a%20service%20definition,purchasing%20and%20installing%20them%20locally.","title":"What is Software as a Service (SaaS)? - Microsoft Azure"},{"question":"What date is the SaaS payment?","link":"https://www.saas.gov.uk/need-to-know/payments/loan-payments#:~:text=The%20SLC%20will%20issue%20a,released%20at%20the%20same%20time.","title":"Loan Payments - SAAS"}],"relatedSearches":[{"query":"Saas payments login"},{"query":"Saas payments reddit"},{"query":"SaaS billing"},{"query":"SaaS billing software"},{"query":"Best SaaS billing software"},{"query":"B2B SaaS billing software"},{"query":"Stripe SaaS billing"},{"query":"SaaS billing models"}]}

Since we passed the parser to retrieve the structured JSON and we are printing only that, the response contains:

  • json_content with structured search results including:
  • searchParameters: Information about the search query
  • knowledgeGraph: Detailed information about the search subject (when available)
  • organic: List of search results with title, link, position, and snippet
  • peopleAlsoAsk: Related questions that users commonly search for
  • relatedSearches: Suggested related search queries

If you don’t want the structured JSON but simply the markdown or html you can retrieve those from the retrieve endpoint.

Important Notes

If you want structured JSON you need to pass the specific parser to the API before making the requests. For example if you want to get the JSON from google search url you will pass this parser "parser": "@olostep/google-search" You can create your own parsers to retrieve the data you want from any page. Reach out to info@olostep.com to learn more.

Conclusion

The batch endpoint is useful if you need to get data from many URLs in a short period of time. You need to already have the list of urls you want to get the data from.

Common applications can be:

  • Price tracking services that monitor multiple e-commerce sites for price changes on products
  • Website monitoring tools that check for content updates across numerous pages
  • Data aggregation for concert organizers tracking ticket availability across multiple venues
  • Search engines gathering and indexing content from many websites simultaneously
  • News aggregators collecting articles from various publications
  • Real estate platforms monitoring property listings across multiple sites
  • Job boards aggregating openings from company career pages
  • Financial data services tracking stock prices and market information
  • Social media monitoring tools analyzing mentions across different platforms
  • Academic research gathering data from multiple sources for analysis

It’s better to use the batch endpoint if you want the content from 100 to 10k urls at a time. If you need to scrape less than 50 urls at a time we recommended using the scrape endpoint and submit the urls in parallel since it’s faster than the batch endpoint.