Search the Botcrawl Bot Directory database to identify AI crawlers, search bots, scrapers, scanners, monitoring bots, preview bots, and user-agent patterns.
facebookexternalhit
Neutral
The primary purpose of FacebookExternalHit is to crawl the content of an app or website that was shared on one of Meta’s family of apps, such as Facebook, Instagram, or Messenger. The link.
factset_spyderbot
Neutral
Factset uses a Python Selenium Crawler for web scraping to deliver reliable, current financial data.
falbot
Safe
FalBot is a webhook callback service from fal.ai used for service notifications, callbacks, or integration events.
FastmailUA
Neutral
Fastmail Bot is a crawler or scraper associated with Fastmail, used for public-data collection, crawling, or content extraction.
FDL Stats Bot
Safe
FDL Stats bot is used to generate analytical data around rocket league player information. The bot will attempt to crawl various platforms that provide player data that is publicly.
Fedica
Neutral
Fedicabot is a crawler used for scraping, SEO analysis, or data collection from Fedica.
FedReporterDataBot
Neutral
Bot to download data from the ffiec, Active/Closed/Branches File, Holding Company Data, 002 Data.
Feedbin
Safe
Feedbin is a feed retrieval bot from Feedbin used to retrieve feeds, subscriptions, podcasts, or syndicated content.
feeder.co
Safe
Feeder is a feed retrieval bot from Really Simple AB used to retrieve feeds, subscriptions, podcasts, or syndicated content.
FeedFetcher-Google
Safe
FeedFetcher-Google is a feed retrieval bot from Google used to retrieve feeds, subscriptions, podcasts, or syndicated content.
Feedly/1
Safe
Feedly is a feed retrieval bot from Feedly used to retrieve feeds, subscriptions, podcasts, or syndicated content.
FeedOtter
Neutral
FeedOtter is a feed fetcher bot that retrieves RSS and Atom feeds for content aggregation and distribution.
Feedwind
Safe
Accesses feed sources to ensure feed widget is up to date (crawls every 5 minutes to 5 hours depending on a user's plan).
FishBot
Neutral
FishBot crawls webpages to deliver Open Source AI for All.
follow.it
Safe
This bot is used to fetch the RSS feed content of the websites owned by rightful publishers at follow.it.
Flashy-PHP
Neutral
Flashy-PHP/1.0.0 is a webhook callback service from Flashy-PHP/1.0.0 used for service notifications, callbacks, or integration events.
FlipboardProxy
Neutral
We work with publishers/partners to obtain their content so it is formatted for the Flipboard app.
FlipboardRSS
Safe
Flipboard will use visitor's RSS feed to discover articles and generate article summaries.
FlockWP
Neutral
Manages WordPress sites on behalf of authenticated owners. Syncs data, applies updates, and monitors uptime.
Foregenix
Safe
Foregenix perform security and risk scanning on the web sites of eCommerce merchants for a number of banks and card brands globally. The service assists these organisations in controlling.
4f.at/crawler
Neutral
4F operates a web crawler on behalf of its users. It continuously monitors sites for broken links and failing assets.
crawler.freespoke.com
Safe
Freespoke is a search engine that believes in free speech and shows you all viewpoints.
Freshping
Safe
Freshping is a monitoring bot from freshping used to check website availability, performance, or page health.
FullFact
Neutral
FullFact Ingest is a feed retrieval bot from FullFact used to retrieve feeds, subscriptions, podcasts, or syndicated content.