-
-
Notifications
You must be signed in to change notification settings - Fork 4.1k
Closed
Description
I know the WebsiteAgent exists, but it'd be nice to have a real RSS agent as well. RSS/Atom provide data with better fields, and people expect feeds to be crawled (not always the case with straight-up web content [does the WebsiteAgent obey robots.txt?]). This would also remove the need for the CSS selector business (while it's powerful, it's not exactly convenient).