database expert with scrapping knowledge

Profile

database expert with scrapping knowledge
We have a site that we want to function as an aggregator of jobs from other sites. We have an existing script that will scrape jobs from another site but need someone to interface that scrapper with our existing site so that the jobs are then automatically post those on our site and keep them updated on our site. The scrapper functions by outputting a .csv file on a cron job that runs every 24 hours.
Our site is wordpress with custom PHP scripting. The database uses tables and wordpress database so you must be VERY familiar with how wordpress works and databases in general. The scrapper currently outputs a .csv.
You must have experience with this type of a project. The database part of this is most important. Lots of people can build a scrapper but few can automate it with a DB properly. Again, the wordpress theme is entirely custom.
Milestone 1 - dig into the current set up and figure out how to interface all the pieces that exist and if they are interfaceable.
Milestone 2- update and/or create a new scrapper to work within the way you want to achieve the goal. Link this scrapper to a automated process to scrape once every 24 hours and have that data imported to our website. The data must be imported and displayed in the format that we already have it and link to the our database tables properly. The entire process needs to be identical to if you had post a job on our website directly.
The scrapper must scrape all available data and import that automatically into our sites format. IF our site has categories that can not be scrapped and filled out the scrapper and its automated process must put in the blank field a tbd. The minimum number of fields that the scrapper must scrape and automate into our site are:
Job title
job category
pay rate
expiration date off of the original site, not the date posted to ours
post date off of the original site, not the date posted to ours
pay type
job description
company name and all company information and have that properly link to the jobs and our database
All imported scrapped jobs must properly link to our databases and format themselves to conform to our site.
If you have carefully read this please put the weather in New York City today, in your message. We dont have time for auto responses or people that are just applying to everything.
Please include a note telling us why we should choose you. Payment will be in milestones after you complete the entire project as we have no need for partial completion. Additionally all aspects of the scrapper and the interfacing must have a package built in that auto-restarts the scripts when the server re-boots.
Skills:
PHP
, Web Scraping
, MySQL
, WordPress
, Database Development

Company info

Sign Up Now - MiamiCrossing.com