Comments on: shelob the evil bot (spider from juniper networks)

By: Erik

Erik — Sat, 10 Oct 2009 13:11:13 +0000

I'm not from Juniper, but security-lab1.juniper.net is a Tor exit node, so it is possible another party was running their bot through Junipers hidden service.

By: Erik

Erik — Sat, 10 Oct 2009 06:11:13 +0000

I'm not from Juniper, but security-lab1.juniper.net is a Tor exit node, so it is possible another party was running their bot through Junipers hidden service.

By: Expert Sem

Expert Sem — Thu, 10 Apr 2008 19:25:15 +0000

I just got hit by the bot also. It got stuck on a few 404 error pages. A security agency shouldn’t be making evil spider bots.

By: Lain

Lain — Wed, 09 Apr 2008 14:52:17 +0000

Well, I was just hit by this bot, and my bot trap captured it within 3 page indexes, it hit my index page, one more then went straight for the “bad bot trap”. My logs show a blank referrer, and now this bot will never be allowed on my server again.

Its shameful to think that a so called “security” company will blatantly skip the robots.txt file, then seek the section it should not be indexing to begin with. I bet this company would have me arrested if I disregarded the private property sign on its building and started looking over their documents. My bot trap automatically sends the bot to 403 land upon capture.

The robots.txt file needs to be a legally binding agreement, like a “no trespassers” sign.

By: Rob

Rob — Mon, 07 Apr 2008 19:17:21 +0000

I have no ads on my site and shelob v1.0 is crawling my site http://www.patientfirst.com.

By: Nick

Nick — Sat, 19 Jan 2008 11:32:25 +0000

My page http://ip.needthe.net contains Google AdSense ads and referers. Some of them could be related to Juniper Networks Inc. equipment and/or services. When I for 1st time received click from ads on this page, “shelob v1.0″ entry for 1st time appeared in weblog. Juniper comes and checks pages where their ads/referers appear. Nothing harmful. They go directly to page where their ads are shown and nowhere else therefore no need to check robots.txt .