AgentQL Web Loader
Precise web data extraction for agents
AgentQL Web Loader is a tool that Scrape a url with a given AgentQL query or a natural language description of the data you want to scrape. Create your own AgentQL API key here.
Description
AgentQL Web Loader is powered by AgentQL, an AI-powered query language for scraping web sites and automating workflows.
If you want to extract data in a precise format, use AgentQL natural language queries under the query field to pinpoint data on any web page, including authenticated and dynamically generated content.
Users can define structured data output and apply transforms within queries.
You could also directly describe the data you want to extract under the prompt field to let AgentQL Web Loader automatically generate the format and data.
Installation
Set the environment variable
Arguments
The following parameters can be used to customize the AgentQL Web Loader’s behavior:
| Argument | Type | Description |
|---|---|---|
| url | string | Url of the website to scrape from. |
| query | string | Optional. AgentQL query to scrape the url. Please visit AgentQL Query Language Introduction for more information. |
| prompt | string | Optional. Natural language description of the data you want to scrape. Either query or prompt is required. |
If you want to hack our tool, feel free to do so by modifying src/tools/agentql_tool.py and reference our documentation for AgentQL REST API.