datawebot CLI: ecommerce data from your terminal.
dtwb searches products and runs extraction Jobs from a terminal, a script or any agent that can run commands. It prints one JSON document on stdout, so its output pipes straight into the next step.
npm install --global @datawebot/cli
dtwb login you@example.comCommands
Search products. Or run one exact endpoint.
Every command answers in JSON. Progress, recovery IDs and errors go to stderr, so stdout stays clean.
| Command | What it does |
|---|---|
dtwb login <email> | Sign in by email approval and save a key. Also dtwb register. |
dtwb search <query> | Products for a keyword, on one shop (--site) or across shops. Each result has a product_id. --limit 1-20, --max-credits for a budget. |
dtwb product <url | product_id> | One product's details, by its page URL or a product_id from dtwb search. |
dtwb result <request-id> | Finish a search or product answer that said "working" (--wait), or read its next page (--cursor). Free. |
dtwb site <shop> | What a shop supports and the most each costs. Free; runs nothing. |
dtwb discover [query] | Find endpoints across every store by store, domain or operation. --blueprint-id for one exact endpoint. |
dtwb extract <endpoint> <input> | Run an endpoint on a URL, keyword or ASIN and wait for the first page of results. --async returns at once. |
dtwb status <job-id> | A Job's status, read once. Never submits work. |
dtwb retrieve <job-id> | One page of a Job's results; --wait until it finishes, --cursor for the next page. |
dtwb jobs | Your Jobs, newest first. |
dtwb credits | Your account and credits. |
First run
One search as JSON.
A search that is still running answers working; dtwb result <request-id> --wait finishes it. For Jobs, a keyword uses amazon.com; give a full URL for another marketplace. An interrupted Job keeps running on the server: dtwb retrieve <job-id> --wait picks it up again.
dtwb search "running shoes" --site allbirds.com --limit 5
dtwb product <product_id from the search>
dtwb discover amazon
dtwb extract amazon.search "coffee beans"
dtwb extract amazon.search_items "https://www.amazon.co.uk/s?k=coffee"npx --yes --package=@datawebot/cli dtwb --helpOr let your agent drive it:
Use the datawebot CLI (dtwb) to search Amazon US for Nintendo Switch. Run dtwb --help first.In scripts
Exit codes a script can act on.
0 means success; a search still working is 0 too. 1 means an API, network or local failure, or a failed search or Job. 2 means bad input, or a Job that finished partly: read the JSON. 130 and 143 mean you interrupted it; the Job keeps running on the server.
FAQ
Questions about datawebot
What does the CLI do today?
Two things. dtwb search and dtwb product find products by keyword, on one shop or across shops, and read a product's details, the same as search_products and get_product over MCP. dtwb discover and dtwb extract run one exact endpoint as an extraction Job, for scripts that must read the same source every time.
What do I need?
Node 22.12 or newer, and an email address to sign in. No card, no password.
Where is my key kept?
In ~/.datawebot/credentials, readable only by you, the same file an agent's setup uses. The CLI never prints it. On a server, set DATAWEBOT_API_KEY instead.
What does it cost?
The same credits as everywhere else: by default 5 credits per search or catalogue page and 1 per product page. Failed Jobs are free; an empty Job pays only for pages that loaded. Every account starts with 200 free credits.