Let’s start with DataProvider.com. Their system indexes over 450 million domains in 50 countries all over the world. Well, that’s a big number. On the other hand, Domain Crawler has more than 400 million active domains and 1.1 billion domains overall in our database. You can find more about our research of DataProvider.com here (link).
Next actor is a Webspotter.io which has 7 variables which include tracking specific technologies, certain keywords, traffic, location and number of incoming links. Domain Crawler up offers customers 24 data points, and the number is growing.
There is also another product which deserves to be mentioned. That is Archive.org, the enormous giant of all internet data services, which has more than 20 years of web history accessible through the Wayback Machine. Of course, it’s hard to compete with it right now, but competition is the engine of progress! We have our strengths. Domain Crawler can offer WHOIS and DNS data from 2011, as well as archive snapshots of numerous sites, starting from 2019 at a more attractive price.
Certainly, there is plenty of room for us to develop and improve our services. For example, Rescan.io analyses around 200,000,000 domain names daily. Our mark is 157,000,000 for DNS, SSL certs, tracking specific technologies and services, etc. But given the momentum we gained, we expect to outgrow those numbers soon enough.