Buddy Fetcher: Simple RSS fetcher/aggregator (PHP/MySQL).
Project features:
- collecting remote items (news, jobs etc) from a number of external websites
- using standard input RSS-feeds or custom parsing
- items fetcher can be run as frequently as needed (through scheduled task)
- separate functionality for operations with DB (data access layer)
- filtering items by categories (any number of categories)
- generate output RSS-feeds (filtered by categories also)
- caching logic for input RSS-feeds, web pages and output RSS-feeds
- mobile version is configured in View section (just through separate CSS)
- classic MVC (Model/View/Controller) implementation (own development)
- simple REST API for extracting collected data
- custom rules for item processing (shrink, cut, replace, extract etc)
- custom character mappings for item processing
- own testing framework (universal for PHP, .NET [Core] and Java versions)
Test scripts are located in local/tests folder.
This product was initially ported from original PHP version using own convertor (written in C# and using ~80 regular expressions).
Working NET version, ported from the same original PHP version with the same convertor (using ~150 regular expressions), can be found at http://github.com/buddylancer/fetcher.net.
Websites powered by Buddy Fetcher:
- 1001 Freelance Projects (http://www.1001fp.com)
- 1001 Freelance Projects / RU (http://www.1001fp.ru)
- 1001 Remote Jobs (http://www.1001rejo.com)
- 1001 Remote Jobs / RU (http://www.1001rejo.ru)
Other versions of Buddy Fetcher:
- .NET version - http://github.com/buddylancer/fetcher.net
- .NET Core version - http://github.com/buddylancer/fetcher.net.core
- Java version - http://github.com/buddylancer/fetcher.java
MagpieRSS: a simple RSS integration tool (http://magpierss.sourceforge.net) / Author: Kellan Elliott-McCrea [email protected] / Version: 0.72 / License: GPL
Snoopy: the PHP net client (https://sourceforge.net/projects/snoopy) / Author: Monte Ohrt [email protected] / Copyright (c): 1999-2014, all rights reserved / Version: 2.0.0 / License: GPLv2