6+ Beautiful Soup Jobs in India

Job Title: AI & Automation Engineer

Experience: 3–5 Years

Employment Type: Full-time

Location: On-site

About the Role

We are looking for a passionate and hands-on AI & Automation Engineer to build intelligent automation solutions that improve efficiency and drive business scalability. In this role, you will design and develop automated workflows, build web scrapers and data pipelines, integrate AI/LLM APIs, and create smart systems that eliminate repetitive manual processes.

This position is ideal for someone who enjoys solving real-world business problems using automation, scripting, machine learning, and artificial intelligence technologies.

Key Responsibilities

Design, develop, and maintain automation workflows using platforms such as n8n, Make (Integromat), Zapier, and custom scripts.

Build automation solutions using Python and Google Apps Script for Google Workspace applications, including Google Sheets, Docs, Forms, and Gmail.

Develop and maintain web scraping solutions and data extraction pipelines using tools such as BeautifulSoup, Scrapy, Playwright, or Puppeteer, while adhering to ethical and legal guidelines.

Apply AI and Machine Learning techniques for classification, prediction, data enrichment, document processing, and content generation.

Integrate LLM APIs such as OpenAI, Anthropic Claude, and other AI services into internal tools and automated workflows.

Develop integrations between SaaS platforms, CRMs, databases, spreadsheets, and third-party APIs.

Analyze existing business processes and design end-to-end automation solutions that improve operational efficiency.

Design, manage, and optimize SQL/NoSQL databases supporting automation workflows.

Monitor, troubleshoot, and maintain automation systems to ensure high reliability, scalability, and performance.

Implement proper logging, error handling, monitoring, and documentation for all automation solutions.

Collaborate with cross-functional teams to identify automation opportunities and deliver scalable AI-powered solutions.

Required Skills & Qualifications

Bachelor's degree in Computer Science, Information Technology, B.E., B.Tech, BCA, MCA, or equivalent practical experience.

3–5 years of experience in automation engineering, scripting, AI integration, or related technical roles.

Strong proficiency in Python and/or Google Apps Script.

Hands-on experience with automation platforms such as n8n, Make (Integromat), Zapier, or similar tools.

Experience developing web scrapers using BeautifulSoup, Scrapy, Playwright, Puppeteer, or equivalent frameworks.

Practical experience integrating AI/LLM APIs into business applications.

Good understanding of Machine Learning fundamentals and AI-powered automation.

Strong knowledge of REST APIs, JSON, Webhooks, Authentication, and API integrations.

Experience working with SQL and NoSQL databases.

Strong analytical, debugging, and problem-solving abilities.

Ability to design scalable automation systems from scratch with minimal supervision.

Preferred Skills

Experience with Scikit-learn, TensorFlow, or PyTorch.

Knowledge of Vector Databases, Retrieval-Augmented Generation (RAG), and AI Agents.

Experience with Prompt Engineering and Agentic AI Workflows.

Familiarity with cloud platforms such as AWS, Google Cloud Platform (GCP), or Microsoft Azure.

Experience with Docker, serverless architectures, and cloud-based deployments.

Basic front-end development skills (HTML, CSS, JavaScript) for building internal dashboards and tools.

What We're Looking For

Strong passion for automation and AI technologies.

A builder mindset with the ability to transform manual processes into intelligent automated systems.

Excellent problem-solving and logical thinking skills.

Self-motivated, detail-oriented, and eager to learn emerging AI technologies.

Strong communication and collaboration skills.

Ability to work independently while contributing effectively within a team.

Why Join Us?

Work on cutting-edge AI and automation projects.

Build intelligent systems that have a direct business impact.

Opportunity to experiment with the latest AI technologies and LLMs.

Collaborative environment with continuous learning and growth opportunities.

Exposure to modern automation platforms, cloud technologies, and scalable AI solutions.

Web Scraping engineer

Python web scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines. 

Responsibilities: 

• Develop and maintain a service that extracts website data using scrapers and APIs across multiple sophisticated websites.
• Extract structured/unstructured data and manipulate data through text processing, image processing, regular expressions etc.
• Writing reusable, testable, and efficient code
• Seeking a Python Developer to develop and maintain web scraping solutions using BeautifulSoup, Scrapy, and Selenium.
• Responsibilities include handling dynamic content, proxies, CAPTCHAs, data extraction, optimization, and ensuring data accuracy.
• Implement and maintain robust, full-stack applications for web crawlers.
• Troubleshoot, debug, and improve existing web crawlers and data extraction systems.
• Utilize tools such as Scrapy and the Spider tool to enhance data crawling capabilities.
•  
• Requirements:
• 0.5-2 years of work experience in Python-based web scraping
• Sound understanding and knowledge of Python and good experience in any of the web crawling tools like requests, scrapy, BeautifulSoup, Selenium etc.
• Strong interpersonal, verbal, and written communication skills in English 

We are seeking an experienced Web Scraping Engineer to data extraction efforts for our enterprise clients. In this role, you will be tasked with creating and maintaining robust, large-scale scraping systems for gathering structured data.

Responsibilities:

Develop and optimize custom web scraping tools and workflows.

Integrate scraping systems with data storage solutions like SQL and NoSQL databases.

Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.

Provide technical guidance on scraping best practices and standards.

Skills Required:

Expert in Python and scraping libraries such as Scrapy and BeautifulSoup.

Deep understanding of web scraping techniques and challenges (CAPTCHAs, anti-bot measures).

Experience with cloud platforms (AWS, Google Cloud).

Strong background in databases and data storage systems (SQL, MongoDB).

Role : Web Scraping Engineer

Experience : 2 to 3 Years

Job Location : Chennai

About OJ Commerce: 

OJ Commerce (OJC), a rapidly expanding and profitable online retailer, is headquartered in Florida, USA, with a fully-functional office in Chennai, India. We deliver exceptional value to our customers by harnessing cutting-edge technology, fostering innovation, and establishing strategic brand partnerships to enable a seamless, enjoyable shopping experience featuring high-quality products at unbeatable prices. Our advanced, data-driven system streamlines operations with minimal human intervention.

Our extensive product portfolio encompasses over a million SKUs and more than 2,500 brands across eight primary categories. With a robust presence on major platforms such as Amazon, Walmart, Wayfair, Home Depot, and eBay, we directly serve consumers in the United States.

As we continue to forge new partner relationships, our flagship website, www.ojcommerce.com, has rapidly emerged as a top-performing e-commerce channel, catering to millions of customers annually.

Job Summary:

We are seeking a Web Scraping Engineer and Data Extraction Specialist who will play a crucial role in our data acquisition and management processes. The ideal candidate will be proficient in developing and maintaining efficient web crawlers capable of extracting data from large websites and storing it in a database. Strong expertise in Python, web crawling, and data extraction, along with familiarity with popular crawling tools and modules, is essential. Additionally, the candidate should demonstrate the ability to effectively utilize API tools for testing and retrieving data from various sources. Join our team and contribute to our data-driven success!

Responsibilities:

• Develop and maintain web crawlers in Python.
• Crawl large websites and extract data.
• Store data in a database.
• Analyze and report on data.
• Work with other engineers to develop and improve our web crawling infrastructure.
• Stay up to date on the latest crawling tools and techniques.

Required Skills and Qualifications:

• Bachelor's degree in computer science or a related field.
• 2-3 years of experience with Python and web crawling.
• Familiarity with tools / modules such as
• Scrapy, Selenium, Requests, Beautiful Soup etc.
• API tools such as Postman or equivalent. 
• Working knowledge of SQL.
• Experience with web crawling and data extraction.
• Strong problem-solving and analytical skills.
• Ability to work independently and as part of a team.
• Excellent communication and documentation skills.

What we Offer

• Competitive salary

• Medical Benefits/Accident Cover

• Flexi Office Working Hours

• Fast paced start up

• In-depth knowledge in Core Python with Django building end to endapplications development.
• Experience in Web technologies-HTML, CSS, Javascript.

• Database - SQL Server/Postgres/ NoSQL database.
  
  
• Good understanding of Algorithms, data structures.
• Knowledge in ORM (Object Relational Mapper) libraries.
  
  
• Experience in integrating multiple data sources and databases into onesystem.
  
  
• Knowledge in REST / SOAP API
• Knowledge in version control tools like Git
• Experience with various cloud technologies.