Skip to content

buddylancer/fetcher.php

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

35 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

fetcher.php

Buddy Fetcher: Simple RSS fetcher/aggregator (PHP/MySQL).

Project features:

  • collecting remote items (news, jobs etc) from a number of external websites
  • using standard input RSS-feeds or custom parsing
  • items fetcher can be run as frequently as needed (through scheduled task)
  • separate functionality for operations with DB (data access layer)
  • filtering items by categories (any number of categories)
  • generate output RSS-feeds (filtered by categories also)
  • caching logic for input RSS-feeds, web pages and output RSS-feeds
  • mobile version is configured in View section (just through separate CSS)
  • classic MVC (Model/View/Controller) implementation (own development)
  • simple REST API for extracting collected data
  • custom rules for item processing (shrink, cut, replace, extract etc)
  • custom character mappings for item processing
  • own testing framework (universal for PHP, .NET [Core] and Java versions)

Test scripts are located in local/tests folder.

This product was initially ported from original PHP version using own convertor (written in C# and using ~80 regular expressions).

Working NET version, ported from the same original PHP version with the same convertor (using ~150 regular expressions), can be found at http://github.com/buddylancer/fetcher.net.

Websites powered by Buddy Fetcher:

Other versions of Buddy Fetcher:

Acknowledgments

MagpieRSS: a simple RSS integration tool (http://magpierss.sourceforge.net) / Author: Kellan Elliott-McCrea [email protected] / Version: 0.72 / License: GPL

Snoopy: the PHP net client (https://sourceforge.net/projects/snoopy) / Author: Monte Ohrt [email protected] / Copyright (c): 1999-2014, all rights reserved / Version: 2.0.0 / License: GPLv2

About

Simple RSS fetcher/aggregator (PHP/MySQL).

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published