Scrapy Actor – Social Media Link Extractor

This actor crawls a list of input URLs and extracts social media links (e.g. Facebook, Twitter/X, Instagram, LinkedIn, YouTube, TikTok, etc.) that exist on those pages.

---

🚀 How it works

1. You provide a list of URLs as input.
2. The actor visits each URL and scrapes all <a> tags.
3. It filters out links that match known social media domains.
4. Results are stored in the Apify dataset in the following structure:

{
  "Input Url": "https://www.example.com/",
  "Facebook": [
    "https://www.facebook.com/example/"
  ],
  "Twitter/X": [],
  "Instagram": [
    "https://www.instagram.com/example/"
  ],
  "LinkedIn": [
    "https://www.linkedin.com/in/example1/",
    "https://www.linkedin.com/in/example2/"
  ],
  "TikTok": [],
  "YouTube": [],
  "Pinterest": [],
  "Reddit": [],
  "Snapchat": [],
  "Tumblr": [],
  "Threads": [],
  "Discord": [],
  "Twitch": [],
  "WhatsApp": [],
  "Raw Text": "Text Data"
}

---

📥 Input

The actor expects a JSON input with an array of URLs:

{
  "startUrls": [
    { "url": "https://example.com" },
    { "url": "https://another.com" }
  ]
}

---

📤 Output

The dataset will contain one item per input URL, with each social platform as its own column.

Input URL	Facebook	Instagram	LinkedIn	Twitter/X	YouTube	TikTok	Pinterest	Reddit	Snapchat	Tumblr	Threads	Discord	Twitch	WhatsApp	Raw Text
https://example.com	https://facebook.com/example	https://instagram.com/example													Full scraped text from the page...
https://another.com			https://linkedin.com/company/test												Full scraped text from the page...

Fields:

1. Input URL – the page where links were found
2. Facebook – extracted Facebook links (array)
3. Instagram – extracted Instagram link (array)
4. LinkedIn – extracted LinkedIn link (array)
5. Twitter/X – extracted Twitter/X link (array)
6. YouTube – extracted YouTube link (array)
7. TikTok – extracted TikTok link (array)
8. Pinterest – extracted Pinterest link (array)
9. Reddit – extracted Reddit link (array)
10. Snapchat – extracted Snapchat link (array)
11. Tumblr – extracted Tumblr link (array)
12. Threads – extracted Threads link (array)
13. Discord – extracted Discord link (array)
14. Twitch – extracted Twitch link (array)
15. WhatsApp – extracted WhatsApp link (array)
16. Raw Text – all text found on page

---

🌐 Running on Apify

1. Go to the actor’s page on Apify.
2. Click Try actor and provide the input JSON (see Input section).
3. Run the actor.
4. View results in the Dataset tab (exportable as JSON, CSV, or Excel).

---

📚 Example social domains handled

• Facebook → facebook.com, fb.com
• Instagram → instagram.com, instagr.am
• Twitter/X → twitter.com, x.com
• LinkedIn → linkedin.com
• YouTube → youtube.com, youtu.be
• TikTok → tiktok.com
• Pinterest → pinterest.com
• Reddit → reddit.com, redd.it
• Snapchat → snapchat.com, sc.com
• Tumblr → tumblr.com
• Threads → threads.net
• Discord → discord.com, discord.gg
• Twitch → twitch.tv
• WhatsApp → wa.me, whatsapp.com

---

📝 Notes

• Some websites hide social links inside menus, scripts, or dynamic sections. This scraper only extracts static <a> tag links.