datawebotBest Buy scraper API for AI agents and code
datawebot returns Best Buy search results as structured JSON, with the same fields for every shop: title, price, original price, availability, rating, image and link. It runs from your AI agent over MCP or from code over REST on bestbuy.com in United States, at 5 credits per search page, and failed requests are free.
How Best Buy structures its product data: Best Buy data guide.
Fields you get
Every Best Buy product comes back in these fields; a field is null when the page doesn't show it. Each endpoint below also lists its raw record schema.
| Field | Type | Description |
|---|---|---|
product_id | string or null | Opaque id. Pass it to get_product (or capability "product") to read the product again. |
title | string | Product title as the shop shows it. |
url | string or null | The product page on the shop. |
shop | string or null | The shop’s hostname, without www. |
price | object or null | amount (number), currency (ISO 4217, or null when the shop doesn’t say) and text (the shop’s own wording when it is the same amount, else null). |
original_price | object or null | The price before a discount, in the same shape as price. |
rating | number or null | Average rating, on the shop’s own scale. |
review_count | integer or null | Number of reviews or ratings. |
image_url | string or null | Main product image. |
availability | string or null | in_stock, out_of_stock, or the shop’s own stock wording. |
sponsored | boolean or null | true for an ad the shop marks as sponsored; null when the page doesn’t say. |
How to run it
From your agent, after connecting it once with the setup prompt (agent setup), ask in plain words:
Use datawebot to extract https://www.bestbuy.com/site/searchpage.jsp?st=wireless+headphones and give me each product's title, price and link as JSON.From code, send one request with your API key. The answer has the same shape for every shop; if it says "status": "working", read it again with GET /v1/requests/{id}.
curl https://api.datawebot.com/v1/requests \
-H "Authorization: Bearer $DATAWEBOT_API_KEY" \
-H "Content-Type: application/json" \
-d '{"capability":"endpoint","endpoint":"bestbuy.search_items","url":"https://www.bestbuy.com/site/searchpage.jsp?st=wireless+headphones","format":"structured"}'Search
Best Buy US keyword search (https://www.bestbuy.com/site/searchpage.jsp?st=<keyword>), first SSR grid only: the unique skus of the initial Apollo SSR results grid in slot order (24 slots / 22 unique skus observed), sponsored slots flagged (slot source "CE"). SKU, title, product and canonical URL, current and regular price as sent, rating, review count, first fulfillment button state and image. The payload states no currency, so currency is always null (never inferred from the US market). Slots the payload did not hydrate keep null fields and are listed in the report's missing_detail_skus. A verified empty result (numFound 0) returns no records. No parameters, paging, filters or sorting. No product details operation (held).
- ID
bestbuy.search_items- Version
1- Price
- 5 credits / page
- State
- Available
- Typical time
- About 30 s (estimate)
What it does
Reads one search results page (or up to the page limit) and returns one record per product card, in page order. Works on bestbuy.com; other hosts are rejected before anything runs.
Input
One page URL per request, shaped like https://www.bestbuy.com/site/searchpage.jsp?st=wireless+headphones.
Price
5 credits / page. Failed requests are free; a page that loaded but had nothing on it still costs credits. Set max_credits to refuse anything dearer before it runs.
Output
The default, "format": "structured". Every shop answers in the same fields, mapped from the page to the product_summary@1 schema. Fields are null when the page doesn't show them, and a record that can't be mapped is read best-effort from its raw fields. Products are in products, up to 50 a page; follow next_cursor with GET /v1/requests/{id} (MCP: get_results).
| Field | Type | Description |
|---|---|---|
product_id | string or null | Opaque id. Pass it to get_product (or capability "product") to read the product again. |
title | string | Product title as the shop shows it. |
url | string or null | The product page on the shop. |
shop | string or null | The shop’s hostname, without www. |
price | object or null | amount (number), currency (ISO 4217, or null when the shop doesn’t say) and text (the shop’s own wording when it is the same amount, else null). |
original_price | object or null | The price before a discount, in the same shape as price. |
rating | number or null | Average rating, on the shop’s own scale. |
review_count | integer or null | Number of reviews or ratings. |
image_url | string or null | Main product image. |
availability | string or null | in_stock, out_of_stock, or the shop’s own stock wording. |
sponsored | boolean or null | true for an ad the shop marks as sponsored; null when the page doesn’t say. |
{
"request_id": "string",
"status": "done",
"products": [
{
"product_id": "string or null",
"title": "string",
"url": "string or null",
"shop": "string or null",
"price": {
"amount": "number",
"currency": "string or null",
"text": "string or null"
},
"original_price": {
"amount": "number",
"currency": "string or null",
"text": "string or null"
},
"rating": "number or null",
"review_count": "integer or null",
"image_url": "string or null",
"availability": "string or null",
"sponsored": "boolean or null"
}
],
"next_cursor": "string or null",
"meta": {
"as_of": "date-time",
"country": "string",
"credits_used": "integer",
"credits_left": "integer"
}
}Over the Jobs API, GET /v1/jobs/{id}/results?format=structured returns the full product_summary@1 records.
With "format": "raw", the answer keeps the structured fields and adds raw: this endpoint's own records, unchanged, one per item, in the schema below. It is the data the endpoint extracted from the page, not the page's HTML. Same price as structured.
| Field | Type | Description |
|---|---|---|
position | integer required | Grid order of the unique skus, 1..n |
rank | integer required | SSR slot order including sponsored slots, as sent |
sku | string required | Best Buy skuId as sent |
title | string or null required | name.short as sent; null for unhydrated slots |
url | string (uri) or null required | skuSpecificUrl (fallback pdp) as sent; null for unhydrated slots |
canonical_url | string (uri) or null required | url.pdp as sent; null for unhydrated slots |
price | string or null required | displayableCustomerPrice (fallback customerPrice) as sent |
regular_price | string or null required | displayableRegularPrice as sent |
currency | null required | The Search payload states no currency; never inferred |
rating | number or null required | reviewInfo.averageRating as sent |
review_count | integer or null required | reviewInfo.reviewCount as sent |
availability | string or null required | First fulfillment buttonState (for example ADD_TO_CART); a displayed action state, not inventory |
availability_text | string or null required | First fulfillment displayText as sent |
image_url | string (uri) or null required | primaryImage piscesHref/href on bbystatic.com as sent |
sponsored | boolean required | Slot source field set ("CE" observed) in this page view |
page | 1 required | — |
{
"position": "integer",
"rank": "integer",
"sku": "string",
"title": "string or null",
"url": "string (uri) or null",
"canonical_url": "string (uri) or null",
"price": "string or null",
"regular_price": "string or null",
"currency": null,
"rating": "number or null",
"review_count": "integer or null",
"availability": "string or null",
"availability_text": "string or null",
"image_url": "string (uri) or null",
"sponsored": "boolean",
"page": 1
}Raw needs this endpoint: a search with format: "raw" doesn't fall back to shopping search, and answers raw_unavailable where no endpoint can run. Over the Jobs API, results are raw by default; format=both gives each raw record with its structured form.
Request
Run exactly this endpoint with capability: "endpoint"; there is no fallback, and a failed run is free. Set format to "raw" for the raw records too. For a keyword instead of a URL, search_products with this shop as site builds the search URL, tries the shop's endpoint first and then shopping search.
curl https://api.datawebot.com/v1/requests \
-H "Authorization: Bearer $DATAWEBOT_API_KEY" \
-H "Content-Type: application/json" \
-d '{"capability":"endpoint","endpoint":"bestbuy.search_items","url":"https://www.bestbuy.com/site/searchpage.jsp?st=wireless+headphones","format":"structured"}'submit_job {
"endpoint": "bestbuy.search_items",
"url": "https://www.bestbuy.com/site/searchpage.jsp?st=wireless+headphones",
"format": "structured"
}If the answer says "status": "working", read it again with GET /v1/requests/{id} (MCP: get_results) after check_after_seconds.
Limits
- One page URL per request, on bestbuy.com only; other hosts are rejected before anything runs.
- Prices and stock are read when the request runs (
meta.as_of); datawebot keeps no price history, so schedule and store repeat reads yourself. - Fields the page doesn't show come back null; nothing is filled in or guessed.
- Up to 30 requests a minute per account.
Questions about the Best Buy scraper API
Does Best Buy have an official API?
datawebot does not use one. It reads Best Buy's pages and returns them as structured JSON, so you need no Best Buy developer account or partner key. Whether Best Buy offers its own API, and on what terms, is for Best Buy to say.
Can I scrape Best Buy with Python?
Yes. Send the POST /v1/requests call shown on this page from Python with any HTTP client, such as requests or httpx: the same JSON body, with your API key in the Authorization header. The products come back in the answer's products field (product for a product page).
Is it legal to scrape Best Buy?
It depends on where you are, Best Buy's terms and what you do with the data. You stay responsible for how you use what datawebot returns. This is not legal advice; read our guide to robots.txt and legal considerations, and ask a lawyer about your case.
What does a Best Buy scraper API call cost?
5 credits per search page. Failed requests are free; a page that loaded but had nothing on it still costs credits. Every account starts with 200 free credits, and credit packs start at 10,000 credits for $10, with no subscription.
Start with 200 free credits
Connect your agent with one setup prompt, or create an API key, and run Best Buy requests right away. No card and no subscription.
Connect your agent See pricing