What is a scraper node?Updated 2 years ago

A "scraper node" is a technical term we use to describe the system we use for scanning and getting the content of a website. We use a distributed system in order to handle high amounts of submissions, and for a generally load balanced system.

Our distributed system is set out across multiple different hosting providers in multiple different regions. This allows us to effectively and dynamically handle hosting provider outages and ensure our site runs smoothly.

If you see scraper nodes mentioned on our website, this is what we are referring to!