Web Scraping API

Endpoint

POST /v3/universal-ai (sync) Model string pattern: web/scraping/{provider}[/{model}]

Input

Field	Type	Required	Description
url	string	Yes	URL of the web page to scrape

Output

Field	Type	Required
url	string	Yes
content	string	No
title	string	No
description	string	No
status_code	int	No
links	array[string]	No
images	array[object]	No
url	string	Yes
description	string	No
width	int	No
height	int	No
raw_html	string	No
summary	string	No
published_date	string	No
author	string	No
favicon	string	No
usage	dict	No

Available Providers

Provider	Model String	Price
firecrawl	`web/scraping/firecrawl`	$0.0038 per token
linkup	`web/scraping/linkup`	$0.001 per token

Provider Parameters

This subfeature accepts only the provider_params listed for each provider, and rejects any other with 400 Bad Request. Each entry is a path in the provider’s own request format, lowercased, with nested keys joined by dots: send it as nested objects, in the casing the provider documents.

Provider	Accepted parameters
firecrawl	`actions.direction`, `actions.fullpage`, `actions.key`, `actions.milliseconds`, `actions.selector`, `actions.text`, `actions.type`, `blockads`, `excludetags`, `formats`, `includetags`, `location.country`, `location.languages`, `maxage`, `mobile`, `onlymaincontent`, `parsers`, `removebase64images`, `storeincache`, `timeout`, `waitfor`
linkup	`extractimages`, `includerawhtml`, `renderjs`
tavily	`chunks_per_source`, `extract_depth`, `include_favicon`, `include_images`, `query`

Quick Start

import requests

url = "https://api.edenai.run/v3/universal-ai"
headers = {
    "Authorization": "Bearer YOUR_API_KEY",
    "Content-Type": "application/json"
}

payload = {
    "model": "web/scraping/firecrawl",
    "input": {
        "url": "example"
    }
}

response = requests.post(url, headers=headers, json=payload)
print(response.json())

curl -X POST https://api.edenai.run/v3/universal-ai \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "web/scraping/firecrawl",
    "input": {"url": "example"}
  }'

V3 Documentation

Quick Start

Overview

LLMs

Expert Models

General

Organization

Data Governance

Integrations

Endpoint

Input

Output

Available Providers

Provider Parameters

Quick Start

​Endpoint

​Input

​Output

​Available Providers

​Provider Parameters

​Quick Start

Endpoint

Input

Output

Available Providers

Provider Parameters

Quick Start