Systematically browses the World Wide Web to collect information (seen in the last 30 days)

1,135 ASNs and 15,060 IP Addresses tagged with crawler.


AS16509	Amazon.com, Inc.		2,596	44.244.224.213
AS714	Apple Inc.		1,370	17.22.237.156
AS16276	OVH SAS		1,083	92.222.104.198
AS14618	Amazon.com, Inc.		713	68.67.112.18
AS13238	YANDEX LLC		649	213.180.203.152
AS32934	Facebook, Inc.		575	57.141.8.20
AS15169	Google LLC		567	66.249.69.65
AS4837	CHINA UNICOM China169 Backbone		519	112.86.225.12
AS24940	Hetzner Online GmbH		475	144.76.23.52
AS136907	HUAWEI CLOUDS		378	114.119.146.252
AS4134	CHINANET BACKBONE		348	114.103.80.59
AS8075	Microsoft Corporation		328	20.71.69.210
AS396982	Google LLC		314	35.187.63.218
AS51747	Internet Vikings International AB		239	193.180.166.198
AS210743	Babbar SAS	—	227	217.113.196.187
AS140577	Ahrefs Pte Ltd		200	168.100.149.85
AS45899	VNPT Corp		193	103.131.71.45
AS13335	Cloudflare, Inc.		126	172.70.175.159
AS5089	Virgin Media Limited		71	62.252.232.7
AS36040	Google LLC		64	136.22.128.13
AS5410	Bouygues Telecom SA		57	213.44.23.4
AS812	Rogers Communications Canada Inc.		53	174.114.176.87
AS6327	Shaw Communications		49	24.244.14.139
AS6805	Telefonica Germany GmbH & Co.OHG		49	77.189.123.9
AS7941	Internet Archive		47	207.241.233.213