Web Scraping Engineer at OJCommerce · Chennai · 2 - 5 years · ₹7L - ₹12L / yr · Bootstrapped · Posted 2 Feb 2024
PythonRole : Web Scraping Engineer
Experience : 2 to 3 Years
Job Location : Chennai
About OJ Commerce:
OJ Commerce (OJC), a rapidly expanding and profitable online retailer, is headquartered in Florida, USA, with a fully-functional office in Chennai, India. We deliver exceptional value to our customers by harnessing cutting-edge technology, fostering innovation, and establishing strategic brand partnerships to enable a seamless, enjoyable shopping experience featuring high-quality products at unbeatable prices. Our advanced, data-driven system streamlines operations with minimal human intervention.
Our extensive product portfolio encompasses over a million SKUs and more than 2,500 brands across eight primary categories. With a robust presence on major platforms such as Amazon, Walmart, Wayfair, Home Depot, and eBay, we directly serve consumers in the United States.
As we continue to forge new partner relationships, our flagship website, www.ojcommerce.com, has rapidly emerged as a top-performing e-commerce channel, catering to millions of customers annually.
Job Summary:
We are seeking a Web Scraping Engineer and Data Extraction Specialist who will play a crucial role in our data acquisition and management processes. The ideal candidate will be proficient in developing and maintaining efficient web crawlers capable of extracting data from large websites and storing it in a database. Strong expertise in Python, web crawling, and data extraction, along with familiarity with popular crawling tools and modules, is essential. Additionally, the candidate should demonstrate the ability to effectively utilize API tools for testing and retrieving data from various sources. Join our team and contribute to our data-driven success!
Responsibilities:
- Develop and maintain web crawlers in Python.
- Crawl large websites and extract data.
- Store data in a database.
- Analyze and report on data.
- Work with other engineers to develop and improve our web crawling infrastructure.
- Stay up to date on the latest crawling tools and techniques.
Required Skills and Qualifications:
- Bachelor's degree in computer science or a related field.
- 2-3 years of experience with Python and web crawling.
- Familiarity with tools / modules such as
- Scrapy, Selenium, Requests, Beautiful Soup etc.
- API tools such as Postman or equivalent.
- Working knowledge of SQL.
- Experience with web crawling and data extraction.
- Strong problem-solving and analytical skills.
- Ability to work independently and as part of a team.
- Excellent communication and documentation skills.
What we Offer
• Competitive salary
• Medical Benefits/Accident Cover
• Flexi Office Working Hours
• Fast paced start up
Shubham Vishwakarma
Full Stack Developer - Averlon
About OJCommerce
About
Company social profiles
Similar jobs (1)
Python
DjangoDjango + Scraper Developer – Job Description
Position: Django + Scraper Developer
Job Summary
We are looking for a skilled Django + Web Scraping Developer with 3+ years of experience in developing scalable web applications using Django and building robust web scrapers. The ideal candidate should have strong Python knowledge, experience with scraping frameworks and APIs, and the ability to work with databases and third-party integrations.
Key Responsibilities
- Develop, maintain, and enhance web applications using Python and Django.
- Design and implement reliable web scraping solutions for extracting structured data from websites.
- Develop scrapers using tools such as Scrapy, Selenium, BeautifulSoup, Requests, or similar technologies.
- Handle dynamic websites, pagination, authentication, proxies, CAPTCHA-related challenges, and anti-bot mechanisms where legally and technically appropriate.
- Clean, validate, transform, and store scraped data in databases.
- Develop and integrate REST APIs and third-party APIs.
- Work with databases such as MySQL, PostgreSQL, or MongoDB.
- Optimize scraper performance, reliability, and data accuracy.
- Troubleshoot and fix issues related to scraping, Django applications, APIs, and databases.
- Write clean, reusable, and maintainable Python code.
- Collaborate with developers, project managers, and other stakeholders to understand project requirements.
- Perform testing, debugging, and performance optimization.
Required Skills
- 3+ years of professional experience in Python/Django development.
- Strong knowledge of Python and Django.
- Hands-on experience with Web Scraping / Data Extraction.
- Experience with Scrapy, Selenium, BeautifulSoup, Requests, or equivalent tools.
- Good understanding of HTML, CSS, JavaScript, DOM, and HTTP/HTTPS.
- Experience working with REST APIs and JSON.
- Good knowledge of SQL and databases such as MySQL/PostgreSQL.
- Understanding of Git/version control.
- Strong debugging and problem-solving skills.
Good to Have
- Experience with Celery, Redis, Docker, and Linux.
- Knowledge of cloud platforms such as AWS.
- Experience handling large-scale scraping projects.
- Understanding of proxy rotation, browser automation, and anti-bot techniques.
- Experience with data pipelines and ETL processes.
What We Offer
- Opportunity to work on challenging and real-world projects.
- Collaborative and growth-oriented work environment.
- Learning and professional development opportunities.
- Competitive salary based on skills and experience.
How to Apply
Interested candidates can share their updated resume along with their current salary, expected salary, notice period, and total experience.
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon