Bots

Browse the bot database.

Official Confidence: High Official Documented

YandexComBot

YandexComBot is a search crawler associated with Yandex and identified by the YandexComBot user-agent pattern.

Yandex Yandex Search Crawler Indexing YandexComBot
Verified robots.txt: No Safe Block: Depends
Official Confidence: High Official Documented

YandexBlogs

YandexBlogs is a search crawler associated with Yandex and identified by the YandexBlogs user-agent pattern.

Yandex Yandex Search Crawler Indexing YandexBlogs
Verified robots.txt: Yes Safe Block: Depends
Official Confidence: High Official Documented

YandexAdNet

YandexAdNet is a search crawler associated with Yandex and identified by the YandexAdNet user-agent pattern.

Yandex Yandex Search Crawler General Crawl YandexAdNet
Verified robots.txt: Yes Safe Block: Depends
Official Confidence: High Official Documented

YandexAdditionalBot

YandexAdditionalBot is a search crawler associated with Yandex and identified by the YandexAdditionalBot user-agent pattern.

Yandex Yandex Search Crawler YandexAdditionalBot
Verified robots.txt: No Neutral Block: Depends
Official Confidence: High Official Documented

YandexAdditional

YandexAdditional is a search crawler associated with Yandex and identified by the YandexAdditional user-agent pattern.

Yandex Yandex Search Crawler YandexAdditional
Verified robots.txt: No Neutral Block: Depends
Official Confidence: High Official Documented

YaDirectFetcher

YaDirectFetcher is a monitoring bot associated with Yandex and identified by the YaDirectFetcher user-agent pattern.

Yandex Yandex Monitoring Monitor YaDirectFetcher
Verified robots.txt: No Safe Block: Depends
Confidence: Medium

TikTokSpider

TikTokSpider is a scraper or crawler associated with ByteDance and identified by the TikTokSpider user-agent pattern.

ByteDance ByteDance Scraper Fetcher User Triggered TikTokSpider
Verified robots.txt: Yes Safe Block: Depends
Confidence: Medium

TikTok

TikTok is a preview fetcher associated with ByteDance and identified by the TikTok user-agent pattern.

ByteDance ByteDance Unknown Preview TikTok
Verified robots.txt: Yes Safe Block: Depends
Confidence: Medium

SeekrBot

SeekrBot is a search crawler associated with Seekr and identified by the SeekrBot user-agent pattern.

Seekr Seekr Search Crawler SeekrBot
Verified robots.txt: Yes Neutral Block: Depends
Confidence: Medium

Seekr

Seekr is a search crawler associated with Seekr and identified by the Seekr user-agent pattern.

Seekr Seekr Search Crawler Seekr
Verified robots.txt: Yes Neutral Block: Depends
Confidence: Medium

Meltwater

Meltwater is a monitoring bot associated with Meltwater and identified by the Meltwater user-agent pattern.

Meltwater Meltwater Monitoring Monitor Meltwater
Verified robots.txt: Yes Neutral Block: Depends
Confidence: Medium

FacebookBot

FacebookBot is a search crawler associated with Meta and identified by the FacebookBot user-agent pattern.

Meta Meta Search Crawler FacebookBot
Verified robots.txt: Yes Neutral Block: Depends