Sunday, September 28, 2014

Job Scraper Plugin



Wordpress Plugin to scrap Job Vacancies from companies.

Step 1 - The scraper will visit the company vacancies page [e.g.Eskom.co.za/careers], grab the job vacancies, send the data to a database, process the data and auto-post. Vacancies will be published under the company name [Eskom] which is the database and category of the vacancies. Job vacancies will be published as posts.

Step 2 – The system will scan the database/category, search job descriptions by configured keyword e.g. Cape Town, Administrative Assistant, Electrician and automatically tag the job description (Wordpress post) with that keyword.

How The Plugin Works:

User will first create a Website Setting for entering Variables, URL to scrape, Tags, and Auto-posting settings. User can create many Website Settings for different sites or URLs i.e. Website Settings 1, Website Settings 2 and so on.

-          Each website setting is a database and category
-          The system will run a keyword search/scan in the database and automatically tag the post containing the keyword.[Up to 200 keywords can be entered in the configuration settings]
-          Auto posting: The wp cron will be set by the plugin which will create the posts per day, with maximum flexibility settings in the admin area of wp-mobile-gen cron settings.
-          Plugin should automatically generate a Job number (Sequential numbering) for each job post in that Website Setting.
-          Web scraper should continually look for updates every day.
-          Ability to set default image for each website setting in the Admin
-          Ability to see the number of generated posts for each setting
-          Ability to set and edit variables in the Admin.To see all Admin and Wordpress Post settings, see the screenshot below: