Introducing ScrapeShield: Discover, Defend & Deter Content Scraping
Content scraping is a common issue faced by publishers, where their original content is copied and republished on other websites without permission. This automated process often involves bots that grab the content and republish it onto link farm sites. To combat this problem, CloudFlare has introduced ScrapeShield, an app designed to detect, defend against, and deter content scrapers. The app uses invisible tracking beacons in the content, which are pulled by automated bots when they scrape the content. This helps publishers identify where their content is being republished. Additionally, CloudFlare's Maze feature redirects known content scrapers to a virtual labyrinth of gibberish and gobbledygook, consuming their resources without affecting the publisher's site. ScrapeShield also includes an option to add the no-pinning meta tag to prevent images from being pinned on sites like Pinterest.
Company
Cloudflare
Date published
March 29, 2012
Author(s)
Matthew Prince
Word count
693
Hacker News points
None found.
Language
English