> For the complete documentation index, see [llms.txt](https://ailyze.gitbook.io/ailyze-docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://ailyze.gitbook.io/ailyze-docs/collect-research-data/collect-social-media-and-web-data.md).

# Collect Social Media & Web Data

This page shows you how to turn a list of links into ready-to-analyze data. Paste or upload your URLs, and Evidano extracts the comments, posts, reviews, and page content into a downloadable ZIP.

{% hint style="info" %}
**What you need:** An Evidano account and the public URLs (posts, videos, reviews, or web pages) you want to collect. Your first 100 URL extractions are free.

**What you will have at the end:** A ZIP file — one spreadsheet per social or structured source, and one document per general web page — ready to analyze.
{% endhint %}

## What you can collect

Evidano works with dozens of platforms, plus any general web page. Examples include:

* **Social:** YouTube, Facebook, Instagram, TikTok, X/Twitter, LinkedIn, Reddit, Threads.
* **Reviews and marketplaces:** Amazon, Trustpilot, Tripadvisor, Yelp, Google Maps, Steam, ProductHunt.
* **Other:** Change.org petitions, Kickstarter and Indiegogo comments, and **any general web page** (collected as a document).

<figure><img src="/files/o0H2HkQ3mZugQp7yL5E3" alt="The Extract Data from URLs page showing supported platforms"><figcaption></figcaption></figure>

The tool is a 3-step flow: **"Choose Extraction"** → **"Add URLs"** → **"Download Results"**. From your account page, click **"Get Social Media Web Data"** to open the **Extract Data from URLs** page.

## Step 1: Choose Extraction

The recommended option is **"Auto-detect Platform"** — Evidano figures out each URL's source for you. Or filter by platform and pick a specific type (for example, *YouTube Comments*). Each card shows the expected URL format, the data fields you'll get, and a **"Preview sample output data"** button.

<figure><img src="/files/7JFmcNPDDmWZzVki84b6" alt="Choosing an extraction type, with Auto-detect Platform recommended"><figcaption></figcaption></figure>

## Step 2: Add URLs

Add your links two ways:

* **Paste URLs** — one per line. A live counter shows how many were detected.
* **Upload File** — a CSV or XLSX with the URLs in a single column (with a header row).

<figure><img src="/files/6IpP4FIOEBfWsCLGOKMs" alt="Adding URLs by pasting a list or uploading a file"><figcaption></figcaption></figure>

{% hint style="info" %}
**URL format matters.** There's no separate "number of comments" or "date range" field — any such limits must be part of the URL itself (for example, an X/Twitter search URL using `since:` and `until:`). If a valid URL is flagged as invalid, see [Social media & web data issues](/ailyze-docs/troubleshooting/social-media-web-data-issues.md).
{% endhint %}

## Step 3: Download Results

Review the **"Confirm URLs"** dialog, which lists each URL, its detected type, and what you'll receive. Click **"Start Extraction"**. If a charge applies, confirm it with the **"Extract Data"** button.

When it finishes, you'll see **"Extraction Complete! 🎉"** and a **"Download ZIP File"** button. Your download is a ZIP called `extracted_data.zip`.

<figure><img src="/files/e6WhfcEkVm5Zv4bDX8eT" alt="Confirming URLs and downloading the extracted data ZIP"><figcaption></figcaption></figure>

### What's in the download

`extracted_data.zip` contains:

* **One spreadsheet per social or structured URL**, with columns specific to that source. For example, YouTube comments come with Name, Date, Likes, and Comment; Amazon reviews come with Author, Date, Rating, Title, and Review.
* **One document per general web page** (page title, URL, and content).

<figure><img src="/files/Fak5bb7elnfaHpPgL2C2" alt="Opening the downloaded ZIP of spreadsheets and documents"><figcaption></figcaption></figure>

{% hint style="info" %}
**Costs credits:** Your first 100 URL extractions are free. Beyond that, extraction is a pay-as-you-go add-on drawn from your wallet, and you'll confirm any charge before it runs. See [Plans, Limits & Credits](/ailyze-docs/reference/plans-limits-and-credits.md).
{% endhint %}

## Step 4: Send your data to analysis

Right after download, a **"Select Analysis"** prompt appears with two options:

* **"Analyze xlsx/csv files"** — take a collected spreadsheet into spreadsheet analysis.
* **"Analyze docx/pdf files"** — take a collected document into document analysis.

Because the data was just downloaded, you'll re-upload the file you want on the create screen.

## Responsible use

Only collect **publicly available** data, and use it in line with each platform's terms of service and the privacy laws that apply to you (for example, GDPR, Europe's data-protection law, or CCPA, California's). Avoid collecting personal data you don't have a lawful reason to process.

## A realistic example

> **Scenario:** A competitive review analysis. Paste 30 Amazon and Trustpilot product URLs, use **"Auto-detect Platform"**, and download the ZIP. Re-upload the review spreadsheet into spreadsheet analysis, find the [themes](/ailyze-docs/reference/glossary.md#theme) in the review text, and compare across [segments](/ailyze-docs/reference/glossary.md#segment) by rating to contrast complaints and praise.

## Next steps

* [Analyze social media discussions](/ailyze-docs/common-research-workflows/analyze-social-media-discussions.md)
* [Analyze product reviews](/ailyze-docs/common-research-workflows/analyze-product-reviews.md)
* [Social media & web data issues](/ailyze-docs/troubleshooting/social-media-web-data-issues.md)


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://ailyze.gitbook.io/ailyze-docs/collect-research-data/collect-social-media-and-web-data.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.