Systematically browses the World Wide Web to collect information (seen in the last 30 days)

1,087 ASNs and 14,925 IP Addresses tagged with crawler.


AS16509	Amazon.com, Inc.		2,688	3.17.76.197
AS714	Apple Inc.		1,385	17.246.15.53
AS16276	OVH SAS		1,087	51.195.244.80
AS14618	Amazon.com, Inc.		710	3.209.174.110
AS13238	YANDEX LLC		649	5.255.231.129
AS15169	Google LLC		573	66.249.65.192
AS32934	Facebook, Inc.		552	173.252.82.10
AS4837	CHINA UNICOM China169 Backbone		520	112.86.225.249
AS24940	Hetzner Online GmbH		478	65.21.113.247
AS136907	HUAWEI CLOUDS		402	114.119.144.55
AS4134	CHINANET BACKBONE		369	111.225.149.174
AS8075	Microsoft Corporation		340	172.203.190.131
AS396982	Google LLC		319	35.195.97.125
AS210743	Babbar SAS	—	234	217.113.194.33
AS51747	Internet Vikings International AB		224	5.133.212.140
AS140577	Ahrefs Pte Ltd		199	168.100.149.90
AS45899	VNPT Corp		193	103.131.71.47
AS13335	Cloudflare, Inc.		121	104.28.229.14
AS5089	Virgin Media Limited		69	62.252.170.134
AS36040	Google LLC		63	136.22.149.5
AS5410	Bouygues Telecom SA		55	213.44.17.133
AS7941	Internet Archive		49	207.241.232.170
AS55836	Reliance Jio Infocomm Limited		48	115.246.59.150
AS6805	Telefonica Germany GmbH & Co.OHG		48	77.189.113.70
AS701	Verizon Business		47	63.88.73.5