![](http://www.federaljack.com/wp-content/uploads/2009/10/TERMINATOR.jpg)
After studying the "human" visits logs of my log, I have checked the visits done by bots identifiable by their userAgent ... And we can say they are legion.
The major search engines are of course present.
Google
![Description de cette image, également commentée ci-après](http://upload.wikimedia.org/wikipedia/commons/thumb/2/20/Google-Logo.svg/220px-Google-Logo.svg.png)
"Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Bing (Microsoft)
![Logo de Bing](http://upload.wikimedia.org/wikipedia/commons/thumb/e/e9/Bing_logo.svg/230px-Bing_logo.svg.png)
"Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
and another Microsoft bot for Msn
"msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
Yahoo! (I thought they used the Bing search engine ?)
![Description de cette image, également commentée ci-après](http://upload.wikimedia.org/wikipedia/commons/thumb/a/ad/Yahoo_Logo.svg/220px-Yahoo_Logo.svg.png)
"Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)"
"Yahoo! Slurp China"
But also some lesser known engines:
Exalead (French)
![Description de l'image Exalead.png.](http://upload.wikimedia.org/wikipedia/fr/thumb/c/c2/Exalead.png/220px-Exalead.png)
"Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)"
Voilà (French)
![Voila.gif](http://upload.wikimedia.org/wikipedia/fr/1/1f/Voila.gif)
"Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (support.voilabot@orange-ftgroup.com)"
Yacy (a free and decentralized search engine I discovered thanks to my logs)
![Image illustrative de l'article YaCy](http://upload.wikimedia.org/wikipedia/commons/thumb/9/99/YaCy_logo.png/96px-YaCy_logo.png)
"yacybot (webportal-global; amd64 Linux 3.6.10-nrj-desktop-1rosa; java 1.7.0_b147-icedtea; Europe/fr) http://yacy.net/bot.html"
Baidu (Chinese)
![Description de l'image Baidu logo.svg.](http://upload.wikimedia.org/wikipedia/fr/thumb/c/c2/Baidu_logo.svg/220px-Baidu_logo.svg.png)
"Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
Jike (Chinese)
![](http://www.jkcdn.com/content/image/www/T1oCYvB_Cv1RCvBVdK)
"Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)"
Yandex (Russian)
![Yandex](data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAIQAAAA0CAYAAABLjpDSAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAACpVJREFUeNrsXQnUTVUUPu/PmPzpVymr8odIRBlKhqSBVKgkZKVJI5W10lotDatWq6K1RCMpkszLFBLKUPmjOUkIRSIyDxmK/7W3t1+df799zj33/vc97/H2Wvv93j7n7XvvOd89ezj7XpGoKiZFDRoikWHw2Z5Jf4H+jVSW0pZKJEVrJFIRPq8HPom1TMkOeXpTTpL0XiGAAend7JAfm4BoK8h+Al6YHfL0Nxn3Ap+I3gAu9vT3Q+AfA5oL1HWV0DIOlP8D7UfzeOYDd9TGEW+4AuAFGXMFcNZbojHXUOcPonRFngy9izA4koK+v4FrHQM3WDdhiAZlmskYIcibAVcOqPMGQVYAt8yyYwAQhwTZ/kwDxCjgQibPBb4mgLk4gRxKTqOz1jlzAPEt8BdC280B9DUHPoPJdgBPzQ515gAiariDcXKr+dR3oyCbBeZiU3aoMyvsnAS8k7WVUbHkkqu5KAufVwoto7LDnHmA2AA8U2iPh1AudAmFXTqtBZ6bHebMAwTSe0J7Q+C6xTAXkwFNf2WHOTMBMQd4NWs/DriDg7lA89KGSTFyGZMd4swFBMbL44Q+CIiSHnpwJanKZN8Df5Md4swFhKI7+iCTYYbxIg89UjIKU9WHskOc2YDA/YsCbhCAO1vMRSn4vJZJcbWZmB3ezAcE0khBhruXxxt0XABcg8nmq2h0dXZ4jw5AYBHLViarAnyZQcf1Qmh6rKaqM95EShVTW4CnAd/O5JjKniFEIXzPY7PQT6c8WlUaANdRsX0TzJZuI3OFW+8bHc8f905Kad/R/9mlfce22sBn0XcMgZcD/16MMctXse19PP9TyDyizrl0PsWlpsAtgc9WWC6g1A/As4QIUJrLXCbb5rAgVCgSGRq2tVsKW9ibgPNYvwuBD7J+w+Nb4RqVBr5OxbKWG5R9Rx3bezqCeR6tZnGORzWYcn8eeCndtbp+zMhiZraez4nCCrABwNst575NkA1w1I/O+wcGvXjOTyt7QdP9dG76eDzlcczXWf8VpisrCbxUAMXNrF8foU8rARB3KsfyCo0HelwM3v0/s9/8CfySx6Tpg9zCcbKqUxgdDcADHFeFTQ66hitz5riZ0P8PYdWIE5Y37GH937cd/XFhsiewPp+w9pXApQVAIPr3BhjMbh6AWBpwkuKMNRrlPCarEvWLJgkQVRxWTZ0fteiaLfQ37Vo/KPRtbjtyNeC9bMJ3Alemdvy7i7X31aunGA1nh0B/oYeK1U88bLhD1lgQbgNE4eHlT6mPyaystwxwG48JG2/4Hab625MP9YSK1YwGAcQ04TdYjIz7SP0Ek7dbmXeh2wm6pkvJAuBFrN+nh1s84DhDWCUeoLYbmfzgYZ/CDIh6pBaX+ZuEk6yvYrUT/DQ6+QDE38CDKXNaRut7Mtlg6TL7WCbrOsNvJB/neDq2H0C0EfoPZn2e8mFOS1IuSe+7VwBQQwFoN7kAopMAiM+o7RUmXwQcsQBCqViNRZ5lgPoKpzHMByDWUeRjopGC/hctHniB4e41UQefgJjD+mKEd6oAtLWsH6545Q06eziA/iXBdJZ2AUR54N+Fgtk6BABd3osX3AagehQ66qfxjcGRMgEi16L/FuEy+xn6Nhb67qZw0ERdfQCijnCtQy3RANfb2hLWb2R9l6j/96NOEADW05aY0gkHYIKwLD0LfI4mw2Vpcggx+M80qdypyw0p77LbR1/JrGHNyK8hnUs7YTWbbeg7T5BdauiLoe8IAXxN6d+Xa3kZReAZ5QoIRc5ToZCdzCuy9EWja0MYpH1C0uhE4jDItdgHJ0qq/gpzf6YV+45JqMWGvsuEOahv0T2ExpKvXkhdmHwYhenOgPiWPFIbhVn3sJ19x7CwbIozuGcC12QyXAXDevLsFCExttGSQf1TGJezWZZWp1UqsbC5NV3T5ZpsD4HHmrrmFKUlqInlZGf6HJC6lEjJp++4DH8F/LVKrLCKsIghFVRLOOYvgjkLSueylHEcEHsM/f+iCKyiJqtI2VNTAfNrLELDavhXmdM6nvwJX4BQ5B+8oOQHeKeDudjuqAdt2XMUu0vH/tywH1A+xYCoKchWCst2UKohyH6z9N8r3Ci5Hkm1AuKm2o2lP2J5kACiggACVwHcBb1DaBvrw2aONYAqTk0sq1QqKV+QrQtRf1WDw1uRVo48ujGimmkvL0RZpT1W9tc1QHCaRen4QIBAGi0AAm3VZ44mYnyIzmGyqZIgC/PZkjMEGVadXU1gKOWox2s8p1DkJq1IA03JF1eStlI3g7nwenYRQTdIOHn83cvA3YEfU7E0c2GaACK3mCGrF+UZJvc0H2BwiZr2KbmaHtPUc02T5UrHBQRUe8EUYIoZN12mabJ+FFu/ZUB0KknyY3aGqL9cSHpcxl96jGK56eYrkYLBvUuQDWVg0JE7Lw0AES3mahpE/yTy+E8nP6uMh+8UocjDyzluazBPT5JvmFJAVKbwUifcVHnb8puS6siTtBRXSPIxpxiW9+LejGUMeZBbJD8iJ8kXWVfwjteooG+nSR39k8Rl3rRCnBryNaBP0tXSfrfkryQbEOcIslXkQ6Qz7XCMPILSthTkWjqooi99WcIc4/OUsEGWbEAkO3xLFm1yzE0EJSlFfVaI+jEAuIfJnlGJz9zcn2pASLY4E0rVVwqy6spea+GHVgiyOiGeP0Z1F7MVDyvhefUUbuDVTiUgDjnG4OlGSwUZbiZVDUm/tKtZO8RV6F72fT7lJPARh/3Mge+eSkBsMCy96f5uwsWCH4HeessQAbeeybAyqmMIurFol7/oJb5tjxt0n7C2LvpNmmxALDM4mvlpDgiMz78U5LeHpB+du48E+UMhrKC3sYgIHVi98GaE4Od1TBUg8KmjzcKd0NlnyHckaLwgw7fkdLL8xk/q/R1BhnscWJ8QND9UTgDtbFU0AYW+xEYhBM1JBSBwW3yWIMdnC843rB7N0gQQE4VlHQl3EE1v9PdTt4FZ2Y8N4SJmLWtZHPVKBrPbViXWfI4VQupJTIaPJbb4L0PiyI2ECuxFCW+yTSyyvZjuHK5yPSET42EsaH2akCwdXtrCDVJkKz230M/Sv4fhfHBQsTwe35tRg7z1/kp+4MZWdY3l8AcMx8D6h6k0Lr1VrI4VM5lYdLyFJpHTPGE8pH2ZxsKcjEkVIJCGWlQfcDj8kQJECbL1tnPbp4r35FYvFeyJsN5MTyOV+KzFK4Zj5hCwOADz/ZiMiEGxCz2iYuVxyjCxOr0h2O+I4znlBLgGW8SDVUXdyBdSDmYCJ+Q7n+c0kO5+v8RNQ08lvxHI5OuMEny77n4g2UBYIRY6rhBIp5HNNB1ivzYw/MHVxgYgLVfuD7DEbSw/7gsOg4/nPtljiNZQuId7CL9q8v6OE4zh3yqHqfiJfDA9GqkgmNtFHs7pmSrxoejlER+1aVjedR9NRPzV/ytg5o0vJo0k/lcImOnDHbhbVazQFHVspcTJm+r/x/kjBIKydJd+pRLLyrFPfZqAQtK1S1sKJcK+F6qi/33BCoPzKBHWdnQl2x8v+FlNtn6I5s1Xo3wAElYsub6PAnXi6x2vJd8kl26U9XRd6KAvIDPLx7UB+QuFPq6rNjmo8d/s/leAAQCcX0DUIZDoLwAAAABJRU5ErkJggg==)
"Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)"
"Mozilla/5.0 (compatible; YandexImages/3.0; +http://yandex.com/bots)"
Blekko
"Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)"
gimme60
"gimme60 (Gimme60 Store ID Bot; gimme60.com)"
In addition to these search engines, there are also extractors bots data whose activities are less visible on the Internet.
alexa.com (Ranking site)
![Alexa Internet](http://pcache.alexa.com/images/layout/logo.283419f9242f00bc57db3a1090778c51.gif)
"ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)"
a
Twitter bot
![Description de l'image Twitter Bird.svg.](http://upload.wikimedia.org/wikipedia/fr/thumb/c/c8/Twitter_Bird.svg/110px-Twitter_Bird.svg.png)
"Twitterbot/1.0"
A site using Twitter
![](http://www.twitmunin.com/media/rave.png)
"Twitmunin Crawler http://www.twitmunin.com"
And many societies which collect and cross data to sale them to their customers
80legs
![80legs web crawling](http://www.80legs.com/_images/logo.gif)
http://www.80legs.com/webcrawler.html;) Gecko/2008032620"
panscient
![Panscient](http://panscient.com/images/logo.gif)
"panscient.com"
Netcraft
![Netcraft](http://www.netcraft.com/assets/images/logo@2x.png)
"Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com)"
ahrefs
![Ahrefs](https://ahrefs.com/images/ahrefs-3px.gif)
"Mozilla/5.0 (compatible; AhrefsBot/4.0; +http://ahrefs.com/robot/)"
gnip
![](http://ts4.mm.bing.net/th?id=H.5012275138724159&pid=1.7&w=138&h=143&c=7&rs=1)
"UnwindFetchor/1.0 (+http://www.gnip.com/)"
Topsy
![](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgPJwaROWddqukOuCNtwhZ2N9I993r9H6Q76GNjKHqDN8bBgAsbm3NjXefd6MMu5VMpBnfCZ-jufjC_MyacnfssElvKdOKlmbQ1jsiNe0D8ewtC2ybp_E8zMq-haA5sh79bejmzvvNVZ_M/s1600/topsy.png)
"Mozilla/5.0 (compatible; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8"
And a few small bots that I was not able to know the role
"Mozilla/5.0 (compatible; Ezooms/1.0; ezooms.bot@gmail.com)"
"Web front page analyser. robots.txt complaint (norw.acd.inst@gmail.com)"
Next time I'll talk about traces left by geeks on the teapot log!