Crawler
JenkersBot
JenkersBot is retained as an observed crawler identity, but current operator and purpose evidence is insufficient for stronger attribution.
Crawler
KingfisherIngest
KingfisherIngest is a TLDR ingestion crawler used for public-content ingestion associated with the Kingfisher ingestion service.
Crawler
KunatoCrawler
KunatoCrawler is retained as an observed crawler token, but current operator-controlled identity documentation remains insufficient.
Crawler
ListSignalBot
ListSignalBot is a reported crawler identity associated with website and company-data collection.
Crawler
MarketPulseBot
MarketPulseBot is a MarketPulse crawler used for collecting public restaurant menu and pricing information.
Crawler
Meta-ExternalTest
Meta-ExternalTest is a Meta-operated signed test agent for external integrations.
Crawler
NagetBot
NagetBot is an observed crawler token whose current operator and purpose remain unresolved.
Crawler
PayPal Presentment Crawler
PayPal Presentment Crawler is a signed PayPal crawler used to review merchant checkout and PayPal product presence for quality.
Crawler
payroll-bot
payroll-bot is a crawler associated with ADP and used for payroll legal regulatory research; it can be identified by `AdpResearchBot`.
Crawler
PopeTech-CrawlBot
PopeTech-CrawlBot is a crawler associated with Pope Tech and used for accessibility site discovery; it can be identified by `PopeTech-CrawlBot`.
Crawler
PoweredByBot
PoweredByBot is a scanner associated with Keywords Everywhere and used for technology profiling; it can be identified by `PoweredByBot`.
Crawler
RankLatchBot
RankLatchBot is a RankLatch crawler used for read-only SEO audits and scheduled monitoring.
Crawler
RetilyCrawler
RetilyCrawler is a Retily crawler used for on-demand ingestion of customer website content.
Crawler
SemrushBot-ESI
SemrushBot-ESI is a Semrush crawler used for Semrush Enterprise Site Intelligence crawling.
Crawler
SemrushBot-FT
SemrushBot-FT is a Semrush crawler used for plagiarism checking and related content-analysis workflows.
Crawler
SEOAI-Bot
SEOAI-Bot is a Seora audit crawler used for SEO audits of owner-verified websites.
Crawler
SEOJuice-SearchBot
SEOJuice-SearchBot is a SEOJuice crawler used for link-graph and marketing-intelligence indexing.
Crawler
SeoraBot
SeoraBot is a Seora audit crawler used for user-triggered SEO audits of public websites.
Crawler
SpeedyHippoBot
SpeedyHippoBot is a SpeedyHippo crawler used for reading public holiday and travel-deal pages.
Crawler
StandingwirePropertyBot
StandingwirePropertyBot collects public land-for-sale listings and property details.
Crawler
SyntoraDataBot
SyntoraDataBot identifies requests associated with collection of public business website data.
Crawler
TheSkinnyAI-Crawler
TheSkinnyAI-Crawler is a TheSkinnyAI crawler used for indexing customer-owned public content for embedded AI assistants.