Web Scraping Data Engineer

• Design, build web crawlers to scrape data and URLs.
• Integrate the data crawled and scraped into our databases
• Create more/better ways to crawl relevant information
• Strong knowledge of web technologies (HTML, CSS, Javascript, XPath, Regex)
• Understanding of data privacy policies (esp. GDPR) and personally identifiable information
• Develop automated and reusable routines for extracting information from various data sources
• Prepare requirement summary and re-confirm with Operation team
• Translate business requirements into specific solutions
• Ability to relay technical information to non-technical users
• Demonstrate Effective problem solving and analytical skill
• Ability to pay attention to detail, pro-active, critical thinking and accuracy is essential
• Ability to work to deadlines and give realistic estimates

Skills & Expertise

• 2+ years of web scraping experience

• Experience with two or more of the following web scraping frameworks and tools: Selenium, Scrapy, Import.io, Webhose.io, ScrapingHub, ParseHub, Phantombuster, Octoparse, Puppeter, etc.
• Basic knowledge of data engineering (database ingestion, ETL, etc.) 
• Solution orientation and "can do" attitude - with a desire to tackle complex problems.