Blog

ID Ranking official website blog

Search engine spider user agent list

Here are some common spider user-agents used by ID Ranking when simulating crawler access. They will be updated in the future to ensure that ID Ranking remains consistent with Google’s crawler user agent.

Media

Spider Name

User Agent

Google

Google PC

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/W.X.Y.Z Safari/537.36

Google mobile

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

Baidu

Baidu PC

Mozilla/5.0(compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Baidu mobile

Mozilla/5.0(Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,like Gecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0;+http://www. baidu.com/ search/spider.html)

Bing

Bing PC

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) Chrome/

Bing mobile

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36 Edg/W.X.Y.Z (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

Yandex

Yandex

Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.268


The following are the search engine user agents currently used by ID Ranking, which are updated regularly.

5 responses to “Search engine spider user agent list”

  1. Tammi Avatar
    Tammi

    Howdy! This is kind of off toopic but I need some advice from an established blog.
    Is it tough to set up your own blog? I’m not very techincal but I can figure things
    out pretty fast. I’m thinking aboujt making my own but I’m
    nott sure where to start. Do you have any points or suggestions?
    Thanks

    my site :: Tammi

  2. Lupita Avatar
    Lupita

    Hello There. I found your blog using msn. This is a really well written article.
    I will make sujre to bookmark it and return tto read
    more of your useful information. Thanks forr the post.
    I will definitely comeback.

    My page … Lupita

  3. https://61c482f1f0a2e.site123.me/ Avatar
    https://61c482f1f0a2e.site123.me/

    This design iss incredible! You most certainly know how to kewep
    a reader entertained. Between your wit and your videos, I was almost moved to stardt my own blog (well,
    almost…HaHa!) Fantastic job. I really loved what you had to say, and more than that, hhow you presented it.
    Too cool!

    my blog post; https://61c482f1f0a2e.site123.me/

  4. https://Vavada.Webgarden.com/ Avatar
    https://Vavada.Webgarden.com/

    Hello there! I ccould have sworn I’ve visited this website before but after browsing through some off the articles I realized it’snew to me.

    Nonetheless, I’m definitely happy I discovered it
    and I’ll be book-marking it and checking back regularly!

    Feel free tto surf to my webpage – https://Vavada.Webgarden.com/

  5. https://Penzu.com/p/6bb0260c Avatar
    https://Penzu.com/p/6bb0260c

    Hello there, just became aware of your blog through Google,
    and found that itt is truly informative. I’m gonna watch out for brussels.
    I’ll be grateful if you contknue this inn future.
    A lot of people will be benefited from your writing.
    Cheers!

    Here is my page – https://Penzu.com/p/6bb0260c

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.