> ## Agent Instructions
>
> Base URL: https://api.anysite.io
> Authentication: send the `access-token` header. Do NOT use `Authorization: Bearer`.
> Full endpoint catalog: https://app.anysite.io/docs
# Available MCP Endpoints

Complete reference of all 1,100+ Anysite MCP Server endpoints across 600+ data sources

## Endpoint Reference

Complete reference of all **3,600+ endpoints** available through the Anysite MCP Server. For architecture overview and getting started, see [MCP Server Overview](/docs/mcp-server/overview).

> 
All endpoints below are called via `execute(source, category, endpoint, params)`. Endpoint names listed here are used as the `endpoint` parameter.
Use `discover(source, category)` to find the exact parameter schema for any endpoint.

Every `execute()` call returns a `cache_key` — use it with [query_cache and export_data](/docs/mcp-server/data-analysis) for server-side filtering, aggregation, and export.

## Quick Navigation

- [Web Search](#web-search) (1 endpoint)
- [Y Combinator](#y-combinator) (3 endpoints)
- [YouTube](#youtube) (14 endpoints)
- [SEC](#sec) (2 endpoints)
- [LinkedIn](#linkedin) (35 endpoints)
- [Instagram](#instagram) (8 endpoints)
- [Twitter/X](#twitterx) (4 endpoints)
- [Reddit](#reddit) (11 endpoints)
- [Web Parser](#web-parser) (2 endpoints)
- [Other Sources](#other-sources) (~100 endpoints)

---

## Web Search

**Source:** `duckduckgo` | **Category:** `search`

### `duckduckgo_search`

Web search parser (DuckDuckGo) returning structured results.

**Description**: Web search parser by query. Returns up to 20 results sorted by relevance. Powered by DuckDuckGo.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `query` | string | ✅ Yes | - | Search query (e.g., 'python fastapi') | - |
| `count` | integer | ❌ Optional | 10 | Maximum number of results | Min: 1, Max: 20 |
| `request_timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "fastapi tutorial",
  "count": 15,
  "request_timeout": 300
}
```

**Use Cases:**
- Web research and information gathering
- Finding documentation and tutorials
- Competitive intelligence
- Content discovery

---

## Y Combinator

**Source:** `yc` | **Categories:** `company`, `search`

> 
Y Combinator endpoints provide access to startup intelligence, company data, and founder information from the world's most prestigious startup accelerator.

### `get_yc_company`

Get comprehensive information about a Y Combinator company by its slug.

**Description**: Get Y Combinator company information including description, batch, founders, and metrics.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `slug` | string | ✅ Yes | - | Y Combinator company slug (e.g., "airbnb", "stripe", "reddit") | - |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "slug": "airbnb",
  "timeout": 300
}
```

**Response includes:**
- Company name and description
- YC batch (e.g., "W09", "S16")
- Company status (Active, Acquired, Public, Inactive)
- Website and social links
- Founded year and team size
- Location and tags/industries
- Founder information

**Use Cases:**
- Startup research and competitive intelligence
- Investment pipeline analysis
- Batch cohort studies
- Founder background research

---

### `search_yc_companies`

Search Y Combinator companies with advanced filtering options.

**Description**: Search YC companies by keywords, batch, industry tags, and status filters.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `query` | string | ❌ Optional | "" | Search keywords (company name, description, tags) | - |
| `batch` | string | ❌ Optional | - | Filter by batch (e.g., "W23", "S22") | - |
| `status` | string | ❌ Optional | - | Filter by status: "Active", "Acquired", "Public", "Inactive" | - |
| `tags` | array[string] | ❌ Optional | - | Filter by industry tags/categories | - |
| `count` | integer | ❌ Optional | 10 | Maximum number of results | Min: 1, Max: 100 |
| `offset` | integer | ❌ Optional | 0 | Pagination offset | Min: 0 |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "AI",
  "batch": "W23",
  "count": 20,
  "timeout": 300
}
```

**Use Cases:**
- Find companies in specific batches
- Research companies by industry/vertical
- Track acquisitions and successful exits
- Discover emerging startups
- Build investment deal flow

---

### `search_yc_founders`

Search Y Combinator founders with filters for batch, company, industry, and titles.

**Description**: Search YC founders by name, company, batch, industry, and job title.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `query` | string | ❌ Optional | "" | Search by founder name | - |
| `company` | string | ❌ Optional | - | Filter by company slug | - |
| `batch` | string | ❌ Optional | - | Filter by batch (e.g., "W23", "S22") | - |
| `industries` | array[string] | ❌ Optional | - | Filter by YC industries | - |
| `titles` | array[string] | ❌ Optional | - | Filter by founder titles (CEO, CTO, etc.) | - |
| `top_company` | boolean | ❌ Optional | false | Filter for founders of top YC companies only | - |
| `page` | integer | ❌ Optional | 0 | Page number for pagination | Min: 0 |
| `hits_per_page` | integer | ❌ Optional | 100 | Results per page | Min: 1, Max: 100 |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "Sam Altman",
  "industries": ["AI", "Enterprise"],
  "top_company": true,
  "hits_per_page": 20,
  "timeout": 300
}
```

**Response includes:**
- Founder name (first and last)
- Current company and title
- Company slug for further queries
- YC batches and industries
- Avatar/profile picture
- All companies text
- Top company indicator

**Use Cases:**
- Founder background research
- Talent sourcing and recruiting
- Network mapping and connections
- Leadership team analysis
- Serial entrepreneur identification

---

## YouTube

**Source:** `youtube` | **Categories:** `search`, `video`, `channel`

> 
YouTube endpoints provide access to video search, channel videos, detailed video information, comments, and subtitle extraction capabilities.

### `search_youtube_videos`

Search YouTube videos by query with result limit control.

**Description**: Search YouTube videos by query and return structured video data including titles, descriptions, views, and engagement metrics.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `query` | string | ✅ Yes | - | Search query (e.g., "python tutorial", "machine learning basics") | - |
| `count` | integer | ✅ Yes | - | Maximum number of results to return | Min: 1, Max: 600 |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "fastapi tutorial",
  "count": 20,
  "timeout": 300
}
```

**Response includes:**
- Video ID and URL
- Title and description
- View count, likes, and comments
- Upload date and duration
- Channel information
- Thumbnail URLs

**Use Cases:**
- Content research and discovery
- Competitor analysis
- Educational resource finding
- Video trend analysis
- Content strategy planning

---

### `get_youtube_video`

Get comprehensive details about a specific YouTube video by ID or URL.

**Description**: Retrieve detailed information about a YouTube video including metadata, engagement metrics, channel data, and video statistics.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `video` | string | ✅ Yes | - | YouTube video ID or full URL | - |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "video": "dQw4w9WgXcQ",
  "timeout": 300
}
```

Or with full URL:
```json
{
  "video": "https://www.youtube.com/watch?v=dQw4w9WgXcQ",
  "timeout": 300
}
```

**Response includes:**
- Complete video metadata
- View count, likes, dislikes
- Comment count and statistics
- Upload date and duration
- Channel information (name, subscribers)
- Video description and tags
- Category and language
- Thumbnail images

**Use Cases:**
- Video analytics and monitoring
- Content performance tracking
- Competitor video analysis
- SEO research
- Engagement metrics collection

---

### `get_youtube_video_subtitles`

Extract subtitles/captions from a YouTube video in specified language.

**Description**: Retrieve video subtitles (closed captions) with timestamps for accessibility, content analysis, or transcription purposes.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `video` | string | ✅ Yes | - | YouTube video ID or full URL | - |
| `lang` | string | ❌ Optional | "en" | Language code (ISO 639-1 format: 'en', 'ru', 'es', etc.) | - |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "video": "dQw4w9WgXcQ",
  "lang": "en",
  "timeout": 300
}
```

**Response includes:**
- Full subtitle text
- Individual subtitle lines with timestamps
- Language information
- Subtitle count and duration
- Timing synchronization data

**Use Cases:**
- Content transcription
- Accessibility compliance
- Video content analysis
- Translation workflows
- SEO content extraction
- Educational material preparation

---

### `get_youtube_channel_videos`

Get all videos from a YouTube channel by URL, alias, or ID.

**Description**: Retrieve a list of all videos from a YouTube channel including metadata, engagement metrics, and upload information.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `channel` | string | ✅ Yes | - | YouTube channel URL, alias (@username), or channel ID | - |
| `count` | integer | ❌ Optional | 50 | Maximum number of videos to return | Min: 1, Max: 600 |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "channel": "https://www.youtube.com/@mkbhd",
  "count": 30,
  "timeout": 300
}
```

Or with channel alias:
```json
{
  "channel": "@mkbhd",
  "count": 50
}
```

**Response includes:**
- Video ID and URL for each video
- Title and description
- View count, likes, and comments
- Upload date and duration
- Thumbnail URLs
- Channel information

**Use Cases:**
- Channel content audit
- Competitor channel analysis
- Content calendar research
- Video performance benchmarking
- Influencer video inventory

---

### `get_youtube_video_comments`

Get comments for a YouTube video by ID or URL.

**Description**: Retrieve comments from a YouTube video including author information, like counts, and reply data.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `video` | string | ✅ Yes | - | YouTube video ID or full URL | - |
| `count` | integer | ❌ Optional | 50 | Maximum number of comments to return | Min: 1, Max: 600 |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "video": "dQw4w9WgXcQ",
  "count": 100,
  "timeout": 300
}
```

Or with full URL:
```json
{
  "video": "https://www.youtube.com/watch?v=dQw4w9WgXcQ",
  "count": 50
}
```

**Response includes:**
- Comment text and author
- Author channel information
- Like count and reply count
- Comment timestamp
- Is reply flag
- Author profile image

**Use Cases:**
- Sentiment analysis
- Community feedback research
- Product mention tracking
- Competitor comment monitoring
- Influencer engagement analysis

---

## SEC

**Source:** `sec` | **Categories:** `search`, `document`

> 
SEC endpoints provide access to U.S. Securities and Exchange Commission EDGAR database for company filings, financial documents, and regulatory disclosures.

### `search_sec_companies`

Search SEC EDGAR database for company filings with advanced filtering options.

**Description**: Search for SEC filings by company name, ticker symbol, form types, date ranges, and location filters.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `entity_name` | string | ❌ Optional | "" | Company name or ticker symbol (e.g., "Apple", "AAPL") | - |
| `forms` | array[string] | ❌ Optional | null | Form types to include (e.g., ["10-K", "10-Q", "8-K"]) or exclude with '-' prefix (e.g., ["-3", "-4"]) | - |
| `location_codes` | array[string] | ❌ Optional | null | State codes to filter by (e.g., ["CA", "NY"]) | - |
| `date_from` | string | ❌ Optional | null | Start date in YYYY-MM-DD format | - |
| `date_to` | string | ❌ Optional | null | End date in YYYY-MM-DD format | - |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "entity_name": "Apple",
  "forms": ["10-K", "10-Q"],
  "date_from": "2024-01-01",
  "date_to": "2024-12-31",
  "timeout": 300
}
```

**Response includes:**
- Accession number (unique filing ID)
- File name and document type
- Filing date
- Company CIK (Central Index Key)
- Form type
- Document URLs for retrieval

**Use Cases:**
- Financial research and analysis
- Due diligence investigations
- Regulatory compliance monitoring
- Investment research
- Company intelligence gathering
- Historical filing analysis

---

### `get_sec_document`

Retrieve the full content of a specific SEC EDGAR document by its URL.

**Description**: Fetch and parse SEC EDGAR documents including 10-K, 10-Q, 8-K, proxy statements, and other regulatory filings.

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `document_url` | string | ✅ Yes | - | Direct URL to SEC EDGAR document (obtained from search results) | - |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "document_url": "https://www.sec.gov/Archives/edgar/data/320193/000114036125044561/ef20060722_8k.htm",
  "timeout": 300
}
```

**Response includes:**
- Document URL
- Full document content (HTML or XML)
- Content type
- Parsed and cleaned document text

**Use Cases:**
- Financial statement analysis
- Risk factor assessment
- Management discussion review (MD&A)
- Executive compensation analysis
- Merger and acquisition research
- Legal and regulatory compliance

**Common Form Types:**
- **10-K**: Annual report with comprehensive company overview
- **10-Q**: Quarterly financial report
- **8-K**: Current report for significant events
- **DEF 14A**: Proxy statement (shareholder meetings)
- **S-1**: Registration statement for new securities
- **4**: Statement of changes in beneficial ownership

---

## LinkedIn

**Source:** `linkedin` | **Categories:** `search`, `user`, `company`, `post`, `email`, `job_search`, `group`, `google`

> 
LinkedIn is the most comprehensive category with **35 endpoints** covering profiles, companies, posts, search, skills, experience, and engagement data.

### Search & Discovery

**Category:** `search`

#### `search_linkedin_users`

Search for LinkedIn users based on various criteria.

**Description**: Search for LinkedIn users based on various criteria

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `keywords` | string | ❌ Optional | - | General search keywords |
| `first_name` | string | ❌ Optional | - | Filter by first name |
| `last_name` | string | ❌ Optional | - | Filter by last name |
| `title` | string | ❌ Optional | - | Filter by job title |
| `company_keywords` | string | ❌ Optional | - | Filter by company name |
| `school_keywords` | string | ❌ Optional | - | Filter by school name |
| `location` | string | ❌ Optional | - | Filter by location name |
| `count` | integer | ❌ Optional | 10 | Number of results |
| `request_timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "keywords": "software engineer",
  "location": "San Francisco",
  "count": 20
}
```

---

#### `search_linkedin_companies`

Search LinkedIn companies with advanced filtering options.

**Description**: Search LinkedIn companies

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `count` | integer | ✅ Yes | - | Max result count | Max: 1000 |
| `keywords` | string | ❌ Optional | "" | Any keyword for searching in the company page. For exact search put desired keywords into brackets | - |
| `location` | string | ❌ Optional | [] | Location URN or location name | - |
| `industry` | string | ❌ Optional | [] | Industry URN or industry name | - |
| `employee_count` | array[string] | ❌ Optional | [] | Employee count filter | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "keywords": "software company",
  "location": "United States",
  "count": 100
}
```

---

#### `search_linkedin_educations`

Search educational institutions on LinkedIn.

**Description**: Search LinkedIn educations

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `name` | string | ✅ Yes | - | Education name | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "name": "Stanford University",
  "count": 10
}
```

---

#### `search_linkedin_industries`

Search industries on LinkedIn.

**Description**: Search LinkedIn industries

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `name` | string | ✅ Yes | - | Industry name | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "name": "Software",
  "count": 10
}
```

---

#### `search_linkedin_locations`

Search locations on LinkedIn for use in filters.

**Description**: Search LinkedIn locations

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `name` | string | ✅ Yes | - | Location name | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "name": "San Francisco",
  "count": 10
}
```

---

### User Profiles

**Category:** `user`

#### `get_linkedin_profile`

Get detailed information about a LinkedIn profile including experience, education, and skills.

**Description**: Get detailed information about a LinkedIn profile

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | LinkedIn profile URL or username | - |
| `request_timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |
| `with_experience` | boolean | ❌ Optional | true | Include experience data | - |
| `with_education` | boolean | ❌ Optional | true | Include education data | - |
| `with_skills` | boolean | ❌ Optional | true | Include skills data | - |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/john-doe",
  "with_experience": true,
  "with_education": true,
  "with_skills": true
}
```

---

#### `find_linkedin_user_email`

Find LinkedIn user by email address.

**Description**: Find LinkedIn user email

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `email` | string | ✅ Yes | - | Email to get user by email | - |
| `count` | integer | ❌ Optional | 5 | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "email": "john.doe@example.com"
}
```

---

#### `get_linkedin_user_email_db`

Get LinkedIn user email from internal database.

**Description**: Get LinkedIn user email from database

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `profile` | string | ✅ Yes | - | LinkedIn internal_id, profile URL, alias, or set of them (max 10) | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "profile": "https://www.linkedin.com/in/john-doe"
}
```

---

#### `get_linkedin_user_posts`

Get posts from a LinkedIn user profile.

**Description**: Get LinkedIn user posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | User URN (fsd_profile type) or user URL | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `posted_after` | string | ❌ Optional | - | Filter posts created after specified date (timestamp) | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:fsd_profile:ACoAAABCDEF",
  "count": 20
}
```

---

#### `get_linkedin_user_comments`

Get comments from a LinkedIn user.

**Description**: Get LinkedIn user comments

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | User URN (fsd_profile type only) | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `commented_after` | string | ❌ Optional | - | Filter comments created after specified date (timestamp) | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:fsd_profile:ACoAAABCDEF",
  "count": 50
}
```

---

#### `get_linkedin_user_reactions`

Get reactions from a LinkedIn user.

**Description**: Get LinkedIn user reactions

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | User URN (fsd_profile type only) | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:fsd_profile:ACoAAABCDEF",
  "count": 100
}
```

---

### Company Information

**Category:** `company`

#### `get_linkedin_company`

Get comprehensive LinkedIn company information.

**Description**: Get LinkedIn company information

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `company` | string | ✅ Yes | - | Company Alias or URL or URN | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "company": "https://www.linkedin.com/company/microsoft"
}
```

---

#### `get_linkedin_company_employee_stats`

Get employee statistics for a LinkedIn company.

**Description**: Get LinkedIn company employee statistics

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | Company URN | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:company:1234"
}
```

---

#### `get_linkedin_company_posts`

Get posts from a LinkedIn company page.

**Description**: Get LinkedIn company posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | Company URN (company type only) | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:company:1234",
  "count": 20
}
```

---

### Content & Posts

**Category:** `post`

#### `search_linkedin_posts`

Search LinkedIn posts with advanced filters.

**Description**: Search LinkedIn posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `count` | integer | ✅ Yes | - | Max result count | Max: 1000 |
| `keywords` | string | ❌ Optional | "" | Any keyword for searching in the post. For exact search put desired keywords into brackets | - |
| `sort` | string | ❌ Optional | "relevance" | Sort type | - |
| `date_posted` | string | ❌ Optional | "past-month" | Date posted filter | - |
| `content_type` | string | ❌ Optional | - | Desired content type | - |
| `mentioned` | string | ❌ Optional | - | Mentioned users URN in posts | - |
| `authors` | string | ❌ Optional | - | Authors URN of posts | - |
| `author_industries` | string | ❌ Optional | - | Industry URN or industry name | - |
| `author_title` | string | ❌ Optional | - | Author job title | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "keywords": "artificial intelligence",
  "date_posted": "past-week",
  "count": 50
}
```

---

#### `get_linkedin_post`

Get detailed information about a specific LinkedIn post.

**Description**: Get LinkedIn post

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | Post URN or slug | - |
| `include_all_document_images` | boolean | ❌ Optional | false | If enabled, all document images will be included | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:activity:1234567890"
}
```

---

#### `get_linkedin_post_comments`

Get comments from a LinkedIn post.

**Description**: Get LinkedIn post comments

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | Post URN (activity type only) | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `sort` | string | ❌ Optional | "recent" | Sort type. Relevance might not return all results | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:activity:1234567890",
  "count": 50
}
```

---

#### `get_linkedin_post_reactions`

Get reactions from a LinkedIn post.

**Description**: Get LinkedIn post reactions

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | Post URN (activity type only) | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:activity:1234567890",
  "count": 100
}
```

---

#### `get_linkedin_post_reposts`

Get reposts of a LinkedIn post.

**Description**: Get LinkedIn post reposts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `urn` | string | ✅ Yes | - | Post URN (activity type only) | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "urn": "urn:li:activity:1234567890",
  "count": 50
}
```

---

### Jobs & Groups

**Categories:** `job_search`, `group`

#### `search_linkedin_jobs`

Search for job postings on LinkedIn.

**Description**: Search LinkedIn jobs

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `count` | integer | ✅ Yes | - | Max result count | Max: 1000 |
| `keywords` | string | ❌ Optional | "" | Any keyword for searching in the job. For exact search put desired keywords into brackets | - |
| `sort` | string | ❌ Optional | - | Job sorting type | - |
| `experience_level` | string | ❌ Optional | - | Job experience level | - |
| `job_types` | string | ❌ Optional | - | Job types | - |
| `work_types` | string | ❌ Optional | - | Work types | - |
| `industry` | string | ❌ Optional | - | Industry URN | - |
| `company` | string | ❌ Optional | - | Company URN | - |
| `location` | string | ❌ Optional | "worldwide" | Job location | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "keywords": "python developer",
  "location": "San Francisco",
  "count": 50
}
```

---

#### `get_linkedin_group`

Get information about a LinkedIn group.

**Description**: Get LinkedIn group information

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `group` | string | ✅ Yes | - | Group URN or URL | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "group": "https://www.linkedin.com/groups/123456"
}
```

---

### Google Search

**Category:** `google`

#### `search_linkedin_google_company`

Search for LinkedIn company pages via Google.

**Description**: Find LinkedIn company pages using Google search integration for broader discovery

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `query` | string | ✅ Yes | - | Search query for company | - |
| `count` | integer | ❌ Optional | 10 | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "OpenAI",
  "count": 5
}
```

---

### Profile Details

**Category:** `user`

#### `get_linkedin_user_experience`

Get work experience history from a LinkedIn profile.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

#### `get_linkedin_user_education`

Get education history from a LinkedIn profile.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

#### `get_linkedin_user_skills`

Get skills listed on a LinkedIn profile.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

#### `get_linkedin_user_endorsers`

Get endorsers for a LinkedIn profile's skills.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

#### `get_linkedin_user_certificates`

Get certifications from a LinkedIn profile.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

#### `get_linkedin_user_honors`

Get honors and awards from a LinkedIn profile.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

#### `get_linkedin_user_languages`

Get languages listed on a LinkedIn profile.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

#### `get_linkedin_user_patents`

Get patents listed on a LinkedIn profile.

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Profile URL, URN, or username |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "https://www.linkedin.com/in/username"
}
```

---

## Instagram

**Source:** `instagram` | **Categories:** `post`, `search`, `user`

### Posts & Content

**Category:** `post`

#### `get_instagram_post`

Get detailed information about an Instagram post.

**Description**: Get Instagram post by ID

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `post` | string | ✅ Yes | - | Post ID | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "post": "CxOTF-..."
}
```

---

#### `get_instagram_post_comments`

Get comments from an Instagram post.

**Description**: Get Instagram post comments

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `post` | string | ✅ Yes | - | Post ID | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "post": "CxOTF-...",
  "count": 50
}
```

---

#### `get_instagram_post_likes`

Get likes from an Instagram post.

**Description**: Get Instagram post likes

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `post` | string | ✅ Yes | - | Post ID | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "post": "CxOTF-...",
  "count": 100
}
```

---

#### `search_instagram_posts`

**Category:** `search`

Search Instagram posts by query.

**Description**: Search Instagram posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `query` | string | ✅ Yes | - | Search query | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "nature photography",
  "count": 50
}
```

---

### User Profiles

**Category:** `user`

#### `get_instagram_user`

Get Instagram user profile information.

**Description**: Get Instagram user profile

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | User ID, alias or URL | - |
| `with_creation_date` | boolean | ❌ Optional | false | Set to true if you need to get account creation date | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "user": "natgeo",
  "with_creation_date": true
}
```

---

#### `get_instagram_user_friendships`

Get followers or following list from Instagram user.

**Description**: Get Instagram user friendships

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | User ID, alias or URL | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `type` | string | ✅ Yes | - | Type of relationships to fetch (followers/following) | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "user": "natgeo",
  "count": 100,
  "type": "followers"
}
```

---

#### `get_instagram_user_posts`

Get posts from an Instagram user profile.

**Description**: Get Instagram user posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | User ID, alias or URL | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "user": "natgeo",
  "count": 20
}
```

---

#### `get_instagram_user_reels`

Get reels from an Instagram user profile.

**Description**: Get Instagram user reels

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | User ID, alias or URL | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "user": "natgeo",
  "count": 10
}
```

---

## Twitter/X

**Source:** `twitter` | **Categories:** `search`, `user`, `user_tweets`

### Search & Discovery

**Category:** `search`

#### `search_twitter_posts`

Search Twitter/X posts with advanced filtering.

**Description**: Search Twitter posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `count` | integer | ✅ Yes | - | Max result count | - |
| `query` | string | ❌ Optional | "" | Main search query. Can include special operators like from:user, to:user, #hashtag | - |
| `exact_phrase` | string | ❌ Optional | "" | Exact phrase (in quotes). Will be added as "phrase" to the query | - |
| `any_of_these_words` | string | ❌ Optional | - | Any of these words (OR condition) | - |
| `none_of_these_words` | string | ❌ Optional | - | None of these words (NOT condition) | - |
| `these_hashtags` | string | ❌ Optional | - | These hashtags | - |
| `language` | string | ❌ Optional | - | Language of tweets | - |
| `from_these_accounts` | string | ❌ Optional | - | From these accounts | - |
| `to_these_accounts` | string | ❌ Optional | - | To these accounts | - |
| `mentioning_these_accounts` | string | ❌ Optional | - | Mentioning these accounts (username with @) | - |
| `min_replies` | string | ❌ Optional | - | Minimum number of replies | - |
| `min_likes` | string | ❌ Optional | - | Minimum number of likes | - |
| `min_retweets` | string | ❌ Optional | - | Minimum number of retweets | - |
| `from_date` | string | ❌ Optional | - | Starting date for tweets search (timestamp) | - |
| `to_date` | string | ❌ Optional | - | Ending date for tweets search (timestamp) | - |
| `search_type` | string | ❌ Optional | "Top" | Type of search results | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "artificial intelligence",
  "min_likes": "100",
  "count": 50
}
```

---

#### `search_twitter_users`

Search Twitter/X users.

**Description**: Search Twitter users

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `count` | integer | ✅ Yes | - | Max result count | - |
| `query` | string | ❌ Optional | "" | Main search users query | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "python developer",
  "count": 20
}
```

---

### User Data

**Category:** `user`

#### `get_twitter_user`

Get Twitter/X user profile information.

**Description**: Get Twitter user profile

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | User Alias or URL | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "user": "elonmusk"
}
```

---

#### `get_twitter_user_posts`

Get posts from a Twitter/X user.

**Description**: Get Twitter user posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | User ID, alias or URL | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "user": "elonmusk",
  "count": 20
}
```

---

#### `get_twitter_user_tweets`

Get tweets from a Twitter/X user (alternative endpoint).

**Description**: Get Twitter user tweets with extended data

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `user` | string | ✅ Yes | - | User ID, alias or URL | - |
| `count` | integer | ❌ Optional | 10 | Max result count | - |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds | Min: 20, Max: 1500 |

**Example:**
```json
{
  "user": "elonmusk",
  "count": 20
}
```

---

## Reddit

**Source:** `reddit` | **Categories:** `search`, `posts`, `user`

### Search & Content

**Category:** `search`

#### `search_reddit_posts`

Search Reddit posts across all subreddits.

**Description**: Search Reddit posts

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `query` | string | ✅ Yes | - | Main search query | - |
| `count` | integer | ✅ Yes | - | Max result count | - |
| `sort` | string | ❌ Optional | "relevance" | Type of search results sorting | - |
| `time_filter` | string | ❌ Optional | "all" | Time filter for search results | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "query": "machine learning",
  "sort": "relevance",
  "time_filter": "week",
  "count": 50
}
```

---

#### `get_reddit_post`

Get detailed information about a Reddit post.

**Description**: Get Reddit post details

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `post_url` | string | ✅ Yes | - | Reddit post URL or path (e.g., /r/DogAdvice/comments/1o2g2pq/title/ or full URL) | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "post_url": "https://www.reddit.com/r/Python/comments/..."
}
```

---

#### `get_reddit_post_comments`

Get comments from a Reddit post.

**Description**: Get Reddit post comments

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `post_url` | string | ✅ Yes | - | Reddit post URL or path | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "post_url": "https://www.reddit.com/r/Python/comments/..."
}
```

---

### User Data

**Category:** `user`

#### `get_reddit_user_posts`

Get posts by a Reddit user.

**Description**: Get Reddit user's post history

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Reddit username or URL |
| `count` | integer | ❌ Optional | 10 | Max result count |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "spez",
  "count": 20
}
```

---

#### `get_reddit_user_comments`

Get comments by a Reddit user.

**Description**: Get Reddit user's comment history

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Reddit username or URL |
| `count` | integer | ❌ Optional | 10 | Max result count |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "spez",
  "count": 20
}
```

---

#### `get_reddit_user`

Get Reddit user profile information.

**Description**: Get Reddit user profile data

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Reddit username or URL |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "spez"
}
```

---

#### `get_reddit_user_comments_extended`

Get extended comment data for a Reddit user.

**Description**: Get Reddit user comments with additional metadata

**Parameters:**

| Parameter | Type | Required | Default | Description |
|-----------|------|----------|---------|-------------|
| `user` | string | ✅ Yes | - | Reddit username or URL |
| `count` | integer | ❌ Optional | 10 | Max result count |
| `timeout` | integer | ❌ Optional | 300 | Request timeout in seconds |

**Example:**
```json
{
  "user": "spez",
  "count": 20
}
```

---

## Web Parser

**Source:** `webparser` | **Categories:** `parse`, `sitemap`

### Page Extraction

**Category:** `parse`

#### `parse_webpage`

Parse and extract content from any webpage with flexible filtering options.

**Description**: Parse and extract content from a webpage with flexible filtering options

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `url` | string | ✅ Yes | - | URL of the page to parse | - |
| `include_tags` | array[string] | ❌ Optional | - | CSS selectors of elements to include (keep only these) | - |
| `exclude_tags` | array[string] | ❌ Optional | - | CSS selectors or wildcard masks of elements to exclude. Examples: '.sidebar', '*promo*' | - |
| `only_main_content` | boolean | ❌ Optional | false | Extract only main content of the page (heuristic algorithm) | - |
| `remove_comments` | boolean | ❌ Optional | true | Remove HTML comments | - |
| `resolve_srcset` | boolean | ❌ Optional | true | Convert image srcset to src (selects the largest image) | - |
| `return_full_html` | boolean | ❌ Optional | false | Return full HTML document (True) or only body content (False) | - |
| `min_text_block` | integer | ❌ Optional | 200 | Minimum text block size for main content detection (in characters) | - |
| `remove_base64_images` | boolean | ❌ Optional | true | Remove base64-encoded images (reduces output size) | - |
| `strip_all_tags` | boolean | ❌ Optional | false | Remove all HTML tags and return plain text only | - |
| `extract_contacts` | boolean | ❌ Optional | false | Extract links, emails, and phone numbers from the page | - |
| `same_origin_links` | boolean | ❌ Optional | false | Only extract links from the same domain (used with extract_contacts) | - |
| `social_links_only` | boolean | ❌ Optional | false | Only extract social media links (LinkedIn, Twitter/X, Facebook, Instagram, etc.) | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "url": "https://example.com/article",
  "only_main_content": true,
  "strip_all_tags": true,
  "extract_contacts": true
}
```

**Use Cases:**
- Article content extraction
- Contact information gathering
- Social media link discovery
- Web scraping and data collection

---

#### `get_sitemap`

Fetch and parse website sitemap with filtering options.

**Description**: Fetch and parse website sitemap with filtering options

**Parameters:**

| Parameter | Type | Required | Default | Description | Constraints |
|-----------|------|----------|---------|-------------|-------------|
| `url` | string | ✅ Yes | - | Website URL to fetch sitemap from | - |
| `include_patterns` | array[string] | ❌ Optional | - | Regex patterns for URL paths to include (all URLs if not specified) | - |
| `exclude_patterns` | array[string] | ❌ Optional | - | Regex patterns for URL paths to exclude | - |
| `same_host_only` | boolean | ❌ Optional | true | Only include URLs from the same host as the base URL | - |
| `respect_robots` | boolean | ❌ Optional | true | Check robots.txt and respect disallowed URLs | - |
| `count` | integer | ❌ Optional | - | Maximum number of URLs to return | - |
| `return_details` | boolean | ❌ Optional | false | Return detailed sitemap entries (lastmod, changefreq, priority) instead of just URLs | - |
| `timeout` | integer | ❌ Optional | 300 | Max scrapping execution timeout (in seconds) | Min: 20, Max: 1500 |

**Example:**
```json
{
  "url": "https://example.com",
  "count": 100,
  "return_details": true
}
```

**Use Cases:**
- Website structure analysis
- Content inventory
- SEO auditing
- Bulk URL extraction

---

#### Other Sources (~100 endpoints)

  Product Hunt, Google (Maps & Ads), Amazon, Facebook Ads, TikTok, Yahoo, Companies House, Crunchbase, GitHub, and 20+ more — see the plain-language [Data Sources & Capabilities](/docs/data-sources) page for the full list

---

## Common Parameters

Most endpoints share these common parameters:

| Parameter | Type | Default | Description | Constraints |
|-----------|------|---------|-------------|-------------|
| `timeout` | integer | 300 | Maximum execution timeout in seconds | Min: 20, Max: 1500 |

> 
**Timeout Best Practices:**
- Use default 300s for most operations
- Increase to 600-900s for large data extractions
- Use minimum 20s only for quick tests
- Maximum 1500s (25 minutes) for very large datasets

---

## LinkedIn URN Format

> 
Many LinkedIn endpoints require **URN (Uniform Resource Name)** identifiers. URNs can be obtained through search endpoints.

**URN Types:**

- **Profile URN**: `urn:li:fsd_profile:ACoAAABCDEF`
  - Obtained from: `search_linkedin_users`, `get_linkedin_profile`

- **Company URN**: `urn:li:company:1234`
  - Obtained from: `search_linkedin_companies`, `get_linkedin_company`

- **Activity URN** (Posts): `urn:li:activity:1234567890`
  - Obtained from: `search_linkedin_posts`, `get_linkedin_user_posts`

**Getting URNs:**

1. Search for resource using appropriate search tool
2. Extract URN from search results
3. Use URN in subsequent data extraction endpoints

**Example workflow:**
```text
1. search_linkedin_users → get profile URN
2. get_linkedin_user_posts → get post URNs
3. get_linkedin_post_comments → get comments using post URN
```

---

## Best Practices

### Rate Limiting

  
#### Respect Limits

    Monitor your API usage to stay within quota limits. Use `count` parameters wisely.
  

  
#### Batch Operations

    Combine multiple operations where possible instead of making separate calls.
  

  
#### Timeout Management

    Set appropriate timeouts based on expected data volume. Don't use maximum timeout unnecessarily.
  

  
#### Error Handling

    Implement proper error handling and retry logic for production use.
  

### Data Extraction

#### Efficient Workflows

  **Do:**
  - Start with `discover()` to find available endpoints, then use search endpoints to find relevant resources
  - Extract only needed data using optional parameters
  - Use filters to narrow results
  - Set reasonable count limits

  **Don't:**
  - Extract all available data if not needed
  - Make redundant API calls
  - Ignore pagination options
  - Use maximum counts by default

#### LinkedIn Best Practices

  - Always obtain URNs through search endpoints first
  - Use optional boolean parameters (`with_experience`, `with_skills`) to control data volume
  - Leverage location/industry URN filters for precise targeting
  - Use `keywords` with brackets for exact match: `"[software engineer]"`

#### Instagram & Twitter

  - User identifiers can be usernames, URLs, or IDs
  - For historical data, use timestamp filters where available
  - Post IDs are platform-specific formats
  - Consider engagement metrics for content analysis

#### Web Parsing

  - Use `only_main_content=true` for article extraction
  - Leverage `exclude_tags` to remove ads/navigation
  - Enable `extract_contacts` for lead generation
  - Set `strip_all_tags=true` for plain text output

### Security

> 
- Never commit API keys or credentials to version control
- Use environment variables for sensitive data
- Monitor API usage regularly
- Rotate keys periodically
- Follow platform terms of service

---

## Endpoint Statistics

**Total Endpoints**: 1,100+ across 600+ data sources

**MCP Tools**: 5 meta-tools (discover, execute, get_page, query_cache, export_data)

**By Platform:**
- **LinkedIn**: 35 endpoints — Most comprehensive (profiles, companies, posts, skills, experience)
- **Product Hunt**: 23 endpoints — products, launches, makers, collections, topics
- **YouTube**: 14 endpoints
- **Reddit**: 11 endpoints
- **Google**: 10 endpoints — Maps & Ads transparency
- **Instagram**: 8 endpoints
- **Companies House**: 8 endpoints — UK official registry
- **Yahoo**: 7 endpoints — search & finance
- **Amazon**: 5 endpoints
- **Facebook**: 5 endpoints — Ad Library
- **TikTok**: 5 endpoints
- **Twitter/X**: 4 endpoints
- **Y Combinator**: 3 endpoints
- **Crunchbase**: 3 endpoints
- **GitHub**: 3 endpoints
- **SEC**: 2 endpoints
- **Web Parser**: 2 endpoints
- **DuckDuckGo**: 1 endpoint
- **Other Sources**: ~30 endpoints across niche & AI-based scrapers (Capterra, G2, Mercari, OpenCorporates, Siemens, Honeywell, and more)

**By Category:**
- **Search & Discovery**: 40+ endpoints (people, companies, posts, videos, products, web)
- **User & Profile Data**: 30+ endpoints (profiles, skills, experience, education, certificates)
- **Content & Posts**: 30+ endpoints (social posts, videos, launches, reviews)
- **Comments & Engagement**: 15+ endpoints
- **Company & Registry Data**: 25+ endpoints (LinkedIn, YC, Crunchbase, SEC, Companies House)
- **Document & Media Extraction**: 5+ endpoints (SEC documents, YouTube subtitles, web pages)
- **Marketplaces & Ads**: 20+ endpoints (Amazon, Mercari, Facebook & Google Ads)

---

## Usage Examples

### LinkedIn Research Workflow (with query_cache)

```text
1. discover("linkedin", "search")
   → Get available search endpoints and parameters

2. execute("linkedin", "search", "search_users", {keywords: "CTO", location: "San Francisco", count: 50})
   → Get list of CTOs in SF + cache_key

3. query_cache(cache_key, conditions=[{field: "followers", op: ">", value: 1000}])
   → Filter only profiles with 1000+ followers (without loading all 50 into context)

4. execute("linkedin", "user", "get", {user: profile_url})
   → Extract detailed profile information

5. export_data(cache_key, "csv")
   → Download full search results as CSV
```

### Instagram Influencer Analysis

```text
1. execute("instagram", "user", "get", {user: "username"})
   → Get profile metrics

2. execute("instagram", "user", "posts", {user: "username", count: 20})
   → Extract recent posts + cache_key

3. query_cache(cache_key, aggregate={field: "likes", op: "avg"})
   → Calculate average likes per post (server-side)

4. query_cache(cache_key, sort_by="likes", sort_order="desc", limit=5)
   → Get top 5 posts by engagement
```

### Reddit Content Monitoring

```text
1. execute("reddit", "search", "search_posts", {query: "product name", time_filter: "week"})
   → Find relevant discussions + cache_key

2. query_cache(cache_key, sort_by="score", sort_order="desc", limit=10)
   → Get top 10 posts by score

3. execute("reddit", "posts", "get_comments", {post_url: url})
   → Extract all comments
```

### YouTube Video Research

```text
1. execute("youtube", "search", "search_videos", {query: "AI tutorial", count: 50})
   → Find relevant videos + cache_key

2. query_cache(cache_key, sort_by="view_count", sort_order="desc", limit=10)
   → Top 10 by views

3. execute("youtube", "video", "get_subtitles", {video: "video_id", lang: "en"})
   → Get full video transcript
```

### SEC Financial Analysis

```text
1. execute("sec", "search", "search_companies", {entity_name: "Tesla", forms: ["10-K", "10-Q"]})
   → Find recent financial filings

2. execute("sec", "document", "get", {document_url: filing_url})
   → Retrieve full 10-K report
```

---

## Need Help?

  
#### Documentation

    Comprehensive guides and tutorials
  

  
#### API Reference

    Full REST API documentation
  

  
#### MCP Integration

    Setup guides for different clients
  

  
#### Support

    Contact our support team
