5+ Beautiful Soup Jobs in India

We are seeking an experienced Web Scraping Engineer to data extraction efforts for our enterprise clients. In this role, you will be tasked with creating and maintaining robust, large-scale scraping systems for gathering structured data.

Responsibilities:

Develop and optimize custom web scraping tools and workflows.

Integrate scraping systems with data storage solutions like SQL and NoSQL databases.

Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.

Provide technical guidance on scraping best practices and standards.

Skills Required:

Expert in Python and scraping libraries such as Scrapy and BeautifulSoup.

Deep understanding of web scraping techniques and challenges (CAPTCHAs, anti-bot measures).

Experience with cloud platforms (AWS, Google Cloud).

Strong background in databases and data storage systems (SQL, MongoDB).

Profile: Backen API developer

Should be well versed with API knowledge for social media scraping.

Full time remote job

Role : Web Scraping Engineer

Experience : 2 to 3 Years

Job Location : Chennai

About OJ Commerce: 

OJ Commerce (OJC), a rapidly expanding and profitable online retailer, is headquartered in Florida, USA, with a fully-functional office in Chennai, India. We deliver exceptional value to our customers by harnessing cutting-edge technology, fostering innovation, and establishing strategic brand partnerships to enable a seamless, enjoyable shopping experience featuring high-quality products at unbeatable prices. Our advanced, data-driven system streamlines operations with minimal human intervention.

Our extensive product portfolio encompasses over a million SKUs and more than 2,500 brands across eight primary categories. With a robust presence on major platforms such as Amazon, Walmart, Wayfair, Home Depot, and eBay, we directly serve consumers in the United States.

As we continue to forge new partner relationships, our flagship website, www.ojcommerce.com, has rapidly emerged as a top-performing e-commerce channel, catering to millions of customers annually.

Job Summary:

We are seeking a Web Scraping Engineer and Data Extraction Specialist who will play a crucial role in our data acquisition and management processes. The ideal candidate will be proficient in developing and maintaining efficient web crawlers capable of extracting data from large websites and storing it in a database. Strong expertise in Python, web crawling, and data extraction, along with familiarity with popular crawling tools and modules, is essential. Additionally, the candidate should demonstrate the ability to effectively utilize API tools for testing and retrieving data from various sources. Join our team and contribute to our data-driven success!

Responsibilities:

• Develop and maintain web crawlers in Python.
• Crawl large websites and extract data.
• Store data in a database.
• Analyze and report on data.
• Work with other engineers to develop and improve our web crawling infrastructure.
• Stay up to date on the latest crawling tools and techniques.

Required Skills and Qualifications:

• Bachelor's degree in computer science or a related field.
• 2-3 years of experience with Python and web crawling.
• Familiarity with tools / modules such as
• Scrapy, Selenium, Requests, Beautiful Soup etc.
• API tools such as Postman or equivalent. 
• Working knowledge of SQL.
• Experience with web crawling and data extraction.
• Strong problem-solving and analytical skills.
• Ability to work independently and as part of a team.
• Excellent communication and documentation skills.

What we Offer

• Competitive salary

• Medical Benefits/Accident Cover

• Flexi Office Working Hours

• Fast paced start up

• In-depth knowledge in Core Python with Django building end to endapplications development.
• Experience in Web technologies-HTML, CSS, Javascript.

• Database - SQL Server/Postgres/ NoSQL database.
  
  
• Good understanding of Algorithms, data structures.
• Knowledge in ORM (Object Relational Mapper) libraries.
  
  
• Experience in integrating multiple data sources and databases into onesystem.
  
  
• Knowledge in REST / SOAP API
• Knowledge in version control tools like Git
• Experience with various cloud technologies.