![](http://www.federaljack.com/wp-content/uploads/2009/10/TERMINATOR.jpg)
After studying the "human" visits logs of my log, I have checked the visits done by bots identifiable by their userAgent ... And we can say they are legion.
The major search engines are of course present.
![Description de cette image, également commentée ci-après](http://upload.wikimedia.org/wikipedia/commons/thumb/2/20/Google-Logo.svg/220px-Google-Logo.svg.png)
"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Bing (Microsoft)
![Logo de Bing](http://upload.wikimedia.org/wikipedia/commons/thumb/e/e9/Bing_logo.svg/230px-Bing_logo.svg.png)
"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
and another Microsoft bot for Msn
"msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
Yahoo! (I thought they used the Bing search engine ?)
![Description de cette image, également commentée ci-après](http://upload.wikimedia.org/wikipedia/commons/thumb/a/ad/Yahoo_Logo.svg/220px-Yahoo_Logo.svg.png)
"Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
"Yahoo! Slurp China"
But also some lesser known engines:
Exalead (French)
![Description de l'image Exalead.png.](http://upload.wikimedia.org/wikipedia/fr/thumb/c/c2/Exalead.png/220px-Exalead.png)
"Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)"
Voilà (French)
![Voila.gif](http://upload.wikimedia.org/wikipedia/fr/1/1f/Voila.gif)
"Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)"
Yacy (a free and decentralized search engine I discovered thanks to my logs)
![Image illustrative de l'article YaCy](http://upload.wikimedia.org/wikipedia/commons/thumb/9/99/YaCy_logo.png/96px-YaCy_logo.png)
"yacybot (webportal-global; amd64 Linux 3.6.10-nrj-desktop-1rosa; java 1.7.0_b147-icedtea; Europe/fr) http://yacy.net/bot.html"
Baidu (Chinese)
![Description de l'image Baidu logo.svg.](http://upload.wikimedia.org/wikipedia/fr/thumb/c/c2/Baidu_logo.svg/220px-Baidu_logo.svg.png)
"Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
Jike (Chinese)
"Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)"
Yandex (Russian)
"Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
"Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)"
Blekko
![](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgdaTIDmt9igJbt7vSanF0uFpyuuBHxYqD8X5zGyEllqHljwG8qUqIKg2OXpmd6XH7wF7QK-7k70xm_CovDrTPpobchnFsTh3CO2lF6RR9fkdFE54w_-EEfRIovEH58_Q910DknO7eVrKA/s1600/blekko.png)
"Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)"
gimme60
![](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgJgEnYWNUtMY6XG7XissDibjgv5bkImyIhjOz6UgT0NiJiPyKdIHDKo-Dh38Aj9rJGZqhEA7HVQRHD-e0-0BQ3mcndasY01FQXWF0wI_RtSqezH8cVXEKcXF6Zk-OotibrzLO4PSfwnqI/s200/gimme60.com.png)
"gimme60 (Gimme60 Store ID Bot; gimme60.com)"
In addition to these search engines, there are also extractors bots data whose activities are less visible on the Internet.
alexa.com (Ranking site)
![Alexa Internet](http://pcache.alexa.com/images/layout/logo.283419f9242f00bc57db3a1090778c51.gif)
"ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)"
a Twitter bot
![Description de l'image Twitter Bird.svg.](http://upload.wikimedia.org/wikipedia/fr/thumb/c/c8/Twitter_Bird.svg/110px-Twitter_Bird.svg.png)
"Twitterbot/1.0"
A site using Twitter
![](http://www.twitmunin.com/media/rave.png)
"Twitmunin Crawler http://www.twitmunin.com"
And many societies which collect and cross data to sale them to their customers
80legs
![80legs web crawling](http://www.80legs.com/_images/logo.gif)
http://www.80legs.com/webcrawler.html;) Gecko/2008032620"
panscient
![Panscient](http://panscient.com/images/logo.gif)
"panscient.com"
Netcraft
![Netcraft](http://www.netcraft.com/assets/images/logo@2x.png)
"Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com)"
ahrefs
![Ahrefs](https://ahrefs.com/images/ahrefs-3px.gif)
"Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)"
gnip
"UnwindFetchor/1.0 (+http://www.gnip.com/)"
Topsy
![](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgPJwaROWddqukOuCNtwhZ2N9I993r9H6Q76GNjKHqDN8bBgAsbm3NjXefd6MMu5VMpBnfCZ-jufjC_MyacnfssElvKdOKlmbQ1jsiNe0D8ewtC2ybp_E8zMq-haA5sh79bejmzvvNVZ_M/s1600/topsy.png)
"Mozilla/5.0 (compatible; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8"
And a few small bots that I was not able to know the role
"Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)"
"Web front page analyser. robots.txt complaint (norw.acd.inst@gmail.com)"
Next time I'll talk about traces left by geeks on the teapot log!
This is a really cool logo. Thanks for sharing. gutter install
ReplyDelete