Website owners often wish to block web scrapers for a variety of reasons, particularly when they spend a large amount of money generating the data which is being scraped.
The truth is, 'if you can see it, you can scrape it'. Despite all anti-bot measures put in place, even using complex CDN's such as CloudFlare, an advanced scraper can bypass blocking technology and scrape any content a human could see using a normal browser. This is why many companies have resorted to suing those scraping their services, rather than attempt to use more complex anti-scraping measures, as the latter is often more complicated.
The above methods will block a number of simple scrapers, however will not block all advanced scrapers. If you want to ensure 100% that no one scrapes your data, you should keep it off the internet. However, you can make it incredibly challenging for scrapers by using a number of the above techniques.
Written by Ollie Cox