RSS Aggregator and Search Engine Website

This project is to create news RSS aggregator for over 80+ sites and a search engine similar to [url removed, login to view]

I will provide design for Main Page and Inner Search Page (should be around 4 pages since the website will be dynamic)

How RSS aggregator should work?

The aggregator should be multithreaded and designed in the way not to overload the server resources but work efficiently for all 80+ sources using cronjobs and/or other techniques to scrape 100% of data on hourly or daily basis (depending how often news site gets updated).

Title, category (note that article might contain more than one category), author name (if any), date, source URL to the article must be parsed into SQL database as well as fetch image of the post into our server so we can use data to display in our search results.

Example RSS feed:

[url removed, login to view]

[url removed, login to view]

For search engine part, I’ll need features such as filtering options, trends, recent search tags, search suggestion bootstrap.

I’ll need backend/admin for the following:

1: Add additional RSS feeds with option how often should be scraped

2: RSS Alert to alert admin if one of the feeds are no longer working

3: Display data such as amount of post added for specific source/site example [url removed, login to view]

4: Search/Remove/edit specific article

5: RSS tester before it’s added into CMS

6: Bad words / Anti-Spam to prevent users from searching adult related words or if someone is doing search spam we simply strip them for example, use entering keyword “today porn news” our CMS will strip “porn” and make it “today news” (basically I’ll need an option to upload/add txt file with bad words using comma delimited text.

As far as search engine / frontend, just generated SE friendly permalink, generate proper meta title, description and keywords (I’ll explain in details to selected freelancer) as well as how it will display search results.

What framework I’d prefer to build this project?

Laravel, Codeigniter, Phalcon

For search engine?

Sphinxsearch for search performance

Codeigniter Laravel Sphinx Symfony PHP

ID Proiect: #6762894

Detalii despre proiect