Discoveries in web proxy logs
Below is a list of the top 100 IP addresses that have made requests to my website since the beginning of November. It’s a fascinating list, no?
The List
- 5.39.30.12: Roubaix, Hauts-de-France FR AS16276 OVH SAS
- 5.39.40.74: Roubaix, Hauts-de-France FR AS16276 OVH SAS
- 5.39.40.75: Roubaix, Hauts-de-France FR AS16276 OVH SAS
- 5.39.46.84: Roubaix, Hauts-de-France FR AS16276 OVH SAS
- 5.39.60.53: Gravelines, Hauts-de-France FR AS16276 OVH SAS
- 5.39.60.54: Gravelines, Hauts-de-France FR AS16276 OVH SAS
- 54.222.145.109: Beijing, Beijing CN AS55960 Beijing Guanghuan Xinwang Digital
- 54.222.166.55: Beijing, Beijing CN AS55960 Beijing Guanghuan Xinwang Digital
- 54.223.197.183: Beijing, Beijing CN AS55960 Beijing Guanghuan Xinwang Digital
- 54.223.218.46: Beijing, Beijing CN AS55960 Beijing Guanghuan Xinwang Digital
- 5.76.242.149: Almaty, Almaty KZ AS9198 JSC Kazakhtelecom
- 62.128.6.5: Nürnberg, Bavaria DE AS12337 noris network AG
- 65.29.122.234: Lima, Ohio US AS10796 Charter Communications Inc
- 66.183.74.149: Vancouver, British Columbia CA AS852 TELUS Communications Inc.
- 66.220.149.14: Irvine, California US AS32934 Facebook, Inc.
- 66.249.64.191: Ashburn, Virginia US AS15169 Google LLC
- 66.249.66.147: Ashburn, Virginia US AS15169 Google LLC
- 66.249.73.161: Ashburn, Virginia US AS15169 Google LLC
- 66.249.73.191: Ashburn, Virginia US AS15169 Google LLC
- 66.249.79.147: Santa Clara, California US AS15169 Google LLC
- 67.165.189.157: Chicago, Illinois US AS7922 Comcast Cable Communications, LLC
- 67.172.122.239: Chico, California US AS7922 Comcast Cable Communications, LLC
- 67.218.242.3: Palma, Balearic Islands ES AS15704 XTRA TELECOM S.A.
- 70.126.118.210: Largo, Florida US AS33363 Charter Communications, Inc
- 71.105.109.19: New York City, New York US AS701 MCI Communications Services, Inc. d/b/a Verizon Business
- 71.178.28.43: Washington, Washington, D.C. US AS701 MCI Communications Services, Inc. d/b/a Verizon Business
- 71.94.188.211: Walla Walla, Washington US AS20115 Charter Communications
- 74.98.181.67: Virginia Beach, Virginia US AS701 MCI Communications Services, Inc. d/b/a Verizon Business
- 78.212.232.143: Vayrac, Occitanie FR AS12322 Free SAS
- 78.63.209.187: Kaunas, Kaunas LT AS8764 Telia Lietuva, AB
- 81.0.47.164: Talavera de la Reina, Castille-La Mancha ES AS15704 XTRA TELECOM S.A.
- 82.65.161.234: Paris, Île-de-France FR AS12322 Free SAS
- 83.86.42.115: The Hague, South Holland NL AS33915 Vodafone Libertel B.V.
- 84.22.105.146: Alkmaar, North Holland NL AS196752 Tilaa B.V.
- 85.31.186.210: Machern, Saxony DE AS35366 ISPpro Internet KG
- 86.180.254.219: Southend-on-Sea, England GB AS2856 British Telecommunications PLC
- 86.247.20.247: Paris, Île-de-France FR AS3215 Orange S.A.
- 86.253.46.64: Rennes, Brittany FR AS3215 Orange S.A.
- 89.91.176.52: Cergy-Pontoise, Île-de-France FR AS5410 Bouygues Telecom SA
- 90.29.200.184: Caen, Normandy FR AS3215 Orange S.A.
- 92.249.103.176: Kyiv, Kyiv City UA AS29107 Private “Stock company “Sater”
- 96.60.21.225: Salmon Creek, Washington US AS4181 TDS TELECOM
- 98.128.186.74: Stockholm, Stockholm SE AS8473 Bahnhof AB
- 173.252.87.2: Parsons, Kansas US AS32934 Facebook, Inc.
- 181.115.204.74: Cobija, Pando BO AS6568 Entel S.A. - EntelNet
- 188.165.118.137: Lille, Hauts-de-France FR AS16276 OVH SAS
- 199.33.82.18: Peoria, Illinois US AS394404 Samaritan Ministries International
- 202.78.232.138: Kolkata, West Bengal IN AS23860 Alliance Broadband Services Pvt. Ltd.
- 208.107.119.29: Rapid City, South Dakota US AS11232 Midcontinent Communications
- 213.127.88.90: Amsterdam, North Holland NL AS6830 Liberty Global B.V.
- 213.217.225.176: San Pawl il-Baħar, Saint Paul’s Bay MT AS12709 Melita Limited
- 31.167.60.26: Jeddah, Mecca Region SA AS35819 Bayanat Al-Oula For Network Services Limited Co.
- 66.249.75.129: Ashburn, Virginia US AS15169 Google LLC
- 85.191.150.203: Aalborg, North Denmark DK AS43557 Eniig Fiber A/S
- 116.202.237.44: Koblenz, Rheinland-Pfalz DE AS24940 Hetzner Online GmbH
- 212.83.146.233: Paris, Île-de-France FR AS12876 ONLINE S.A.S.
- 35.187.132.129: Ashburn, Virginia US AS15169 Google LLC
- 35.187.132.31: Los Angeles, California US AS15169 Google LLC
- 52.15.152.1: Columbus, Ohio US AS16509 Amazon.com, Inc.
- 70.41.60.90: Roundup, Montana US AS7155 ViaSat,Inc.
- 71.33.218.248: Grand Junction, Colorado US AS209 CenturyLink Communications, LLC
- 107.77.201.196: Dallas, Texas US AS20057 AT&T Mobility LLC
- 109.162.121.181: Kyiv, Kyiv City UA AS15895 Kyivstar PJSC
- 178.150.47.62: Kyiv, Kyiv City UA AS13188 CONTENT DELIVERY NETWORK LTD
- 198.46.227.80: Dallas, Texas US AS36352 ColoCrossing
- 35.187.132.158: Ashburn, Virginia US AS15169 Google LLC
- 61.18.166.123: Hong Kong, Central and Western HK AS9908 HK Cable TV Ltd
- 66.249.72.157: Ashburn, Virginia US AS15169 Google LLC
- 107.77.196.167: Dallas, Texas US AS20057 AT&T Mobility LLC
- 107.77.199.213: Dallas, Texas US AS20057 AT&T Mobility LLC
- 173.180.75.246: Port Coquitlam, British Columbia CA AS852 TELUS Communications Inc.
- 34.232.51.240: Virginia Beach, Virginia US AS14618 Amazon.com, Inc.
- 35.187.132.29: Los Angeles, California US AS15169 Google LLC
- 45.24.234.156: Chicago, Illinois US AS7018 AT&T Services, Inc.
- 51.15.191.81: Paris, Île-de-France FR AS12876 ONLINE S.A.S.
- 62.4.14.198: Paris, Île-de-France FR AS12876 ONLINE S.A.S.
- 70.162.211.58: Mesa, Arizona US AS22773 Cox Communications Inc.
- 107.77.209.81: Chicago, Illinois US AS20057 AT&T Mobility LLC
- 62.4.14.206: Paris, Île-de-France FR AS12876 ONLINE S.A.S.
- 174.21.168.252: Bremerton, Washington US AS209 CenturyLink Communications, LLC
- 195.154.61.206: Paris, Île-de-France FR AS12876 ONLINE S.A.S.
- 35.187.132.159: Ashburn, Virginia US AS15169 Google LLC
- 162.244.33.133: San Jose, California US AS14576 Hosting Solution Ltd.
- 24.148.64.230: Herndon, Virginia US AS6079 RCN
- 35.243.23.159: Mountain View, California US AS15169 Google LLC
- 165.73.69.21: Durban, KwaZulu-Natal ZA AS37611 Afrihost (Pty) Ltd
- 167.114.175.39: Montréal, Quebec CA AS16276 OVH SAS
- 35.243.23.157: Mountain View, California US AS15169 Google LLC
- 35.243.23.130: Mountain View, California US AS15169 Google LLC
- 95.217.118.98: Helsinki, Uusimaa FI AS24940 Hetzner Online GmbH
- 78.47.238.17: Hamburg, Hamburg DE AS24940 Hetzner Online GmbH
- 130.255.162.164: Stockholm, Stockholm SE AS12552 IP-Only Networks AB
- 130.255.162.175: Stockholm, Stockholm SE AS12552 IP-Only Networks AB
- 93.158.90.83: Stockholm, Stockholm SE AS12552 IP-Only Networks AB
- 24.236.218.36: Big Rapids, Michigan US AS20115 Charter Communications
- 62.210.188.240: Paris, Île-de-France FR AS12876 ONLINE S.A.S.
- 95.217.118.100: Helsinki, Uusimaa FI AS24940 Hetzner Online GmbH
- 158.69.241.225: Toronto, Ontario CA AS16276 OVH SAS
- 168.91.196.121: Chicago, Illinois US AS6079 RCN
- 109.102.111.58: Timişoara, Timiş RO AS9050 TELEKOM ROMANIA COMMUNICATION S.A
Turns out a list of 100 anything takes a bit to scroll through…
Observations
First off, before you accuse me of surveillance, consider: all this tells me is that a machine registered at the follow IP address sent an HTTP request to my website. It does not tell me the identity or location of the requestor.
I love how international this list is. Even though some of these are probably users (or bots) using software to further mask their identity behind a wildly inaccurate IP address and the vast majority are probably aggregators of various kinds blindly polling the Internet, it makes me feel more tethered to the world to see so many places represented. French bots are registering my pages, woohoo! And there are a few (can you spot them?) which might, just maybe, be requests from REAL PEOPLE!
I’ve since blocked the last requestor’s IP address after I realized that the requests from IP Address 109.102.111.58 were suspicious. There are dozens of automated requests from aggregators, but these self-identify as such. 109.102.111.58 did not self-identify - even worse, it masks its identity behind a randomized identity. Not cool.
That may be a long list, but I’m an obscure guy. Here are my top three posts by count:
-
(79) /posts/rust-server-docker/
-
(63) /posts/choose-leaders-over-companies/
-
(39) /posts/todderish/
Good thing I don’t do this for the fame…
Filters
Most of you won’t care about this but, for the curious, I did filter out a few requestors.
First, my own IP address. I’m my own biggest fan!
Second, self-identified bots. A lot of them.
- Adsbot/3.1
- AhrefsBot/6.1 & 7.0,
- BLEXBot/1.0
- Bingbot/2.0
- DNSResearchBot/2.1
- Googlebot/2.1
- MJ12bot/v1.4.8
- MojeekBot/0.10
- Nimbostratus-Bot/v1.3.2
- PetalBot
- SemrushBot
- SeznamBot/3.2
- YamanaLab-Robot/1.0
- YandexBot/3.0
- YandexFavicons/1.0
and my favorite…
Serendeputy-bot - shout-out to Jason Butler for creating a landing page that explains why his bot is crawling my site. You can send your bot over anytime, Mr. Butler.
Third, a very special bot, Bytespider. A younger generation might guess who this is from - the same umbrella company that gave us TikTok. It’s behavior is a bit stranger than most. For some reason, it also queries my pages with an appended “depth:[integer]” sometimes even replacing part of the path. For example, it will query this post, /posts/my-biggest-fans and also /posts/my-biggest-depth:2. What that’s about?
That’s more than enough list-making for one day. Congratulations to any of you who might recognize your IP address on this list - you’re enlisted in my Hall of Fame!