feed

Browse bots in this category.

46 bots
ApifyWebsiteContentCrawler Neutral

Apify Website Content Crawler

Website content crawling and extraction for AI applications.

Operator and family: Apify Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
iTMS Neutral

Apple Podcasts

Fetches URLs associated with registered Apple Podcasts content.

Operator and family: Apple Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Official Documented
Arquivo-web-crawler Neutral

Arquivo Web Crawler

Arquivo Web Crawler is a feed retrieval bot from Arquivo used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: Arquivo Type: Feed Purpose: Feed Fetch
Verified robots.txt: Yes Block: Depends Verified Bot
artemis-web-crawler Safe

Artemis Web Crawler

Artemis Web Crawler is a feed retrieval bot from Artemis used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: Artemis Type: Feed Purpose: Feed Fetch
Verified robots.txt: Unknown Block: Depends Verified Bot
Authory Neutral

Authory

The Authory bot visits websites to back up articles on behalf of journalists and other writers who use the service.

Operator and family: Authory Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Awario Neutral

AwarioSmartBot

AwarioSmartBot is a web crawlers sent by Awario to discover and collect new and updated web data (that is further used by Internet marketers from all over the world).

Operator and family: Awario Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
BazQux Safe

Bazqux

The Bazqux Fetcher is how BazQux Reader grabs RSS/Atom feeds and com­ments when users choose to sub­scribe to your blog in BazQux Reader. Fetcher col­lects and pe­ri­od­i­cally re­freshes.

Operator and family: Bazqux Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Blogtrottr Safe

Blogtrottr

Blogtrottr delivers updates from all of your favourite news, feeds, and blogs directly to your email inbox, giving you the flexibility to stay updated whilst on the go.

Operator and family: Blogtrottr Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Buttondown Safe

Buttondown RSS-Feed-Parser

The bot fetches RSS feeds to import into Buttondown newsletters.

Operator and family: Buttondown Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Feedbin Safe

Feedbin

Feedbin is a feed retrieval bot from Feedbin used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: Feedbin Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
feeder.co Safe

Feeder

Feeder is a feed retrieval bot from Really Simple AB used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: Really Simple AB Type: Feed Purpose: Feed Fetch
Verified robots.txt: Yes Block: Depends Verified Bot
FeedFetcher-Google Safe

FeedFetcher-Google

FeedFetcher-Google is a feed retrieval bot from Google used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Official Documented
Feedly/1 Safe

Feedly

Feedly is a feed retrieval bot from Feedly used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: Feedly Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
FeedOtter Neutral

FeedOtter

FeedOtter is a feed fetcher bot that retrieves RSS and Atom feeds for content aggregation and distribution.

Operator and family: FeedOtter Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Feedwind Safe

FeedWind Crawler

Accesses feed sources to ensure feed widget is up to date (crawls every 5 minutes to 5 hours depending on a user's plan).

Operator and family: Mikle Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
follow.it Safe

FIT Feeds Fetcher

This bot is used to fetch the RSS feed content of the websites owned by rightful publishers at follow.it.

Operator: follow.it Family: FIT Feeds Fetcher Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
FlipboardRSS Safe

FlipboardRSS

Flipboard will use visitor's RSS feed to discover articles and generate article summaries.

Operator and family: Flipboard Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
FullFact Neutral

FullFact Ingest

FullFact Ingest is a feed retrieval bot from FullFact used to retrieve feeds, subscriptions, podcasts, or syndicated content.

Operator and family: FullFact Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Google-Calendar-Importer Safe

Google Calendar Importer

Google Calendar fetcher for syncing URL-based calendar feeds.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: No Official Documented
google.com/feedfetcher Safe

Google Feed Fetcher

Google FeedFetcher is the RSS reader for Google.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
GoogleProducer Safe

Google Publisher Center

Fetches and processes feeds that publishers explicitly supplied for use in Google News landing pages.

Operator and family: Google Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
Hotjar Safe

Hotjar

Hotjar provides user analytics and feedback for website owners.

Operator and family: Hotjar Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: No Verified Bot
HubSpot-FeedFetcher Safe

HubSpot Feed Fetcher

When posting to LinkedIn from Hubspot, images need to be pulled through to LinkedIn when published. The crawler performs this function.

Operator and family: HubSpot Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot
IFTTT Safe

IFTTT RSS Feed Service

RSS feed fetcher to power user-configured automations.

Operator and family: IFTTT RSS Feed Servuce Type: Feed Purpose: Feed Fetch
Verified robots.txt: No Block: Depends Verified Bot