8+ Beautiful Soup Jobs in India

Position: Lead Python Developer

Location: Ahmedabad, Gujarat

The Client company includes a team of experienced information services professionals who are passionate about growing and enhancing the value of information services businesses. They provide support with talent, technology, tools, infrastructure and expertise required to deliver across the Data ecosystem. Position Summary We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python, and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures.

Job Responsibility

● Design, develop, and maintain backend systems and services using Python and TypeScript.

● Develop and maintain web scraping solutions to extract, process, and manage large-scale data from multiple sources.

● Work with relational and non-relational

databases, ensuring high availability, scalability, and performance.

● Implement authentication, authorization, and security best practices across services.

● Write clean, maintainable, and testable code following best practices and coding standards.

● Collaborate with frontend engineers, data engineers, and DevOps teams to deliver robust solutions and troubleshoot, debug, and upgrade existing applications.

● Stay updated with backend development trends, tools, and frameworks to continuously improve processes.

● Utilize core crawling experience to design efficient strategies for scraping the data from different websites and applications.

● Collaborate with technology teams, data collection teams to build end to end technology-enabled ecosystems and partner in research projects to analyze the massive data inputs.

● Responsible for the design and development of web crawlers, able to independently solve various problems encountered in the actual development process.

● Stay updated with the latest web scraping techniques, tools, and industry trends to continuously improve the scraping processes.

Job Requirements

● 4+ years of professional experience in backend development with TypeScript and Python.

● Strong understanding of TypeScript-based server-side frameworks (e.g., Node.js, NestJS, Express) and Python frameworks (e.g., FastAPI, Django, Flask).

● Experience with tools and libraries for web scraping (e.g., Scrapy, BeautifulSoup, Selenium, Puppeteer)

● Hands-on experience with Temporal for creating and orchestrating workflows

● Proven hands-on experience in web scraping, including crawling, data extraction, deduplication, and handling dynamic websites.

● Proficient in implementing proxy solutions and handling bot-detection challenges (e.g., Cloudflare).

● Experience working with Docker, containerized deployments, and cloud environments (GCP or Azure).

● Proficiency with database systems such as MongoDB and Elastic Search.

● Hands-on experience with designing and maintaining scalable APIs.

● Knowledge of software testing practices (unit, integration, end-to-end).

● Familiarity with CI/CD pipelines and version control systems (Git).

● Strong problem-solving skills, attention to detail, and ability to work in agile environments.

● Great communication skills and ability to navigate in undirected situations.

Job Exposure:

● Opportunity to apply creative methods in acquiring and filtering the North American government, agencies data from various websites, sources

● In depth industry exposure on data harvesting techniques to build, scale the robust and sustainable model, using open-source applications ● Effectively collaboration with IT team to design the tailor-made solutions basis upon clients’ requirement

● Unique opportunity to research on various agencies, vendors, products as well as technology tools to compose a solution 

Web Scraping engineer

Python web scraping will be responsible for efficient web scraping/web crawling and parsing. The candidate should have demonstrated experience in web scraping and data extraction along with the ability to communicate effectively and adhere to set deadlines. 

Responsibilities: 

• Develop and maintain a service that extracts website data using scrapers and APIs across multiple sophisticated websites.
• Extract structured/unstructured data and manipulate data through text processing, image processing, regular expressions etc.
• Writing reusable, testable, and efficient code
• Seeking a Python Developer to develop and maintain web scraping solutions using BeautifulSoup, Scrapy, and Selenium.
• Responsibilities include handling dynamic content, proxies, CAPTCHAs, data extraction, optimization, and ensuring data accuracy.
• Implement and maintain robust, full-stack applications for web crawlers.
• Troubleshoot, debug, and improve existing web crawlers and data extraction systems.
• Utilize tools such as Scrapy and the Spider tool to enhance data crawling capabilities.
•  
• Requirements:
• 0.5-2 years of work experience in Python-based web scraping
• Sound understanding and knowledge of Python and good experience in any of the web crawling tools like requests, scrapy, BeautifulSoup, Selenium etc.
• Strong interpersonal, verbal, and written communication skills in English 

Role Overview

Python Developer is responsible for building, debugging, and implementing application projects using the Python programming language and developing program specifications and coded modules according to specifications and client standards.

Responsibilities

• Advanced Python Programming: Extensive experience in Python, with a deep understanding of Python principles, design patterns, and best practices. Proficiency in developing scalable and efficient Python code, with a focus on automation, data processing, and backend services. Demonstrated ability with automation libraries like PyAutoGUI for GUI automation tasks, enabling the automation of mouse and keyboard actions.
• Experience with Selenium for web automation: Capable of automating web browsers to mimic user actions, scrape web data, and test web applications.
• Python Frameworks and Libraries: Strong experience with popular Python frameworks and libraries relevant to data processing, web application development, and automation, such as Flask or Django for web development, Pandas and NumPy for data manipulation, and Celery for task scheduling.
• SQL Server Expertise: Advanced knowledge of SQL Server management and development.
• API Development and Integration: Experience in developing and consuming APIs. Understanding of API security best practices. Familiarity with integrating third-party services and APIs into the existing ecosystem.
• Version Control and CI/CD: Proficiency in using version control systems, such as Git. Experience with continuous integration and continuous deployment (CI/CD) pipelines.
• Unit Testing and Debugging: Strong understanding of testing practices, including unit testing, integration testing. Experience with Python testing. Skilled in debugging and performance profiling.
• Containerization and Virtualization: Familiarity with containerization and orchestration tools, such as Docker and Kubernetes, to enhance application deployment and scalability.

Requirements & Skills

• Analytical Thinking: Ability to analyze complex problems and break them down into manageable parts. Strong logical reasoning and troubleshooting skills.
• Communication: Excellent verbal and written communication skills. Ability to effectively articulate technical challenges and solutions to both technical and non-technical team members.
• Team Collaboration: Experience working in agile development environments. Ability to work collaboratively in cross-functional teams and with stakeholders from different backgrounds.
• Continuous Learning: A strong desire to learn new technologies and frameworks. Keeping up to date with industry trends and advancements in healthcare RCM, AI, and automation technologies.

Additional Preferred Skills

• Familiarity with healthcare industry standards and regulations, such as HIPAA, is highly advantageous.
• Understanding of healthcare revenue cycle management processes and challenges.
• Experience with healthcare data formats and standards (e.g., HL7, FHIR) is beneficial.

Educational Qualifications

• Bachelor’s degree in a related field
• Relevant technical certifications are a plus

Title – Python Developer (Healthcare RCM Automation)

·       Department - Technology

·       Shift - Night

·       Location - Noida

·       Education - Graduation

·       Experience – Minimum 3-7 years of professional experience with below skills. 

·       Interpersonal Skills – Good Communication skills, positive attitude and should be confident.

Python Developer is responsible for building, debugging, and implement application projects using the Python programming language and developing program specifications and coded modules according to specifications and client standards.

Responsibilities

·       Advanced Python Programming: Extensive experience in Python, with a deep understanding of Python principles, design patterns, and best practices. Proficiency in developing scalable and efficient Python code, with a focus on automation, data processing, and backend services. Demonstrated ability with automation libraries like PyAutoGUI for GUI automation tasks, enabling the automation of mouse and keyboard actions.

·       Experience with Selenium for web automation: Capable of automating web browsers to mimic user actions, scrape web data, and test web applications.

·       Python Frameworks and Libraries: Strong experience with popular Python frameworks and libraries relevant to data processing, web application development, and automation, such as Flask or Django for web development, Pandas and NumPy for data manipulation, and Celery for task scheduling.

·       SQL Server Expertise: Advanced knowledge of SQL Server management and development. 

·       API Development and Integration: Experience in developing and consuming APIs. Understanding of API security best practices. Familiarity with integrating third-party services and APIs into the existing ecosystem.

·       Version Control and CI/CD: Proficiency in using version control systems, such as Git. Experience with continuous integration and continuous deployment (CI/CD) pipelines

·       Unit Testing and Debugging: Strong understanding of testing practices, including unit testing, integration testing. Experience with Python testing. Skilled in debugging and performance profiling.

·       Containerization and Virtualization: Familiarity with containerization and orchestration tools, such as Docker and Kubernetes, to enhance application deployment and scalability.

Requirements & Skills

·       Analytical Thinking: Ability to analyze complex problems and break them down into manageable parts. Strong logical reasoning and troubleshooting skills.

·       Communication: Excellent verbal and written communication skills. Ability to effectively articulate technical challenges and solutions to both technical and non-technical team members.

·       Team Collaboration: Experience working in agile development environments. Ability to work

collaboratively in cross-functional teams and with stakeholders from different backgrounds.

·       Continuous Learning: A strong desire to learn new technologies and frameworks. Keeping up to date with industry trends and advancements in healthcare RCM, AI, and automation technologies.

Additional Preferred Skills:

·       Industry-Specific Knowledge is a plus:

·       Familiarity with healthcare industry standards and regulations, such as HIPAA, is highly advantageous.

·       Understanding of healthcare revenue cycle management processes and challenges. Experience with healthcare data formats and standards (e.g., HL7, FHIR) is beneficial. 

Educational Qualifications:

·       Bachelor’s degree in a related field.,

·      Relevant technical certifications are a plus

We are seeking an experienced Web Scraping Engineer to data extraction efforts for our enterprise clients. In this role, you will be tasked with creating and maintaining robust, large-scale scraping systems for gathering structured data.

Responsibilities:

Develop and optimize custom web scraping tools and workflows.

Integrate scraping systems with data storage solutions like SQL and NoSQL databases.

Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.

Provide technical guidance on scraping best practices and standards.

Skills Required:

Expert in Python and scraping libraries such as Scrapy and BeautifulSoup.

Deep understanding of web scraping techniques and challenges (CAPTCHAs, anti-bot measures).

Experience with cloud platforms (AWS, Google Cloud).

Strong background in databases and data storage systems (SQL, MongoDB).

Role : Web Scraping Engineer

Experience : 2 to 3 Years

Job Location : Chennai

About OJ Commerce: 

OJ Commerce (OJC), a rapidly expanding and profitable online retailer, is headquartered in Florida, USA, with a fully-functional office in Chennai, India. We deliver exceptional value to our customers by harnessing cutting-edge technology, fostering innovation, and establishing strategic brand partnerships to enable a seamless, enjoyable shopping experience featuring high-quality products at unbeatable prices. Our advanced, data-driven system streamlines operations with minimal human intervention.

Our extensive product portfolio encompasses over a million SKUs and more than 2,500 brands across eight primary categories. With a robust presence on major platforms such as Amazon, Walmart, Wayfair, Home Depot, and eBay, we directly serve consumers in the United States.

As we continue to forge new partner relationships, our flagship website, www.ojcommerce.com, has rapidly emerged as a top-performing e-commerce channel, catering to millions of customers annually.

Job Summary:

We are seeking a Web Scraping Engineer and Data Extraction Specialist who will play a crucial role in our data acquisition and management processes. The ideal candidate will be proficient in developing and maintaining efficient web crawlers capable of extracting data from large websites and storing it in a database. Strong expertise in Python, web crawling, and data extraction, along with familiarity with popular crawling tools and modules, is essential. Additionally, the candidate should demonstrate the ability to effectively utilize API tools for testing and retrieving data from various sources. Join our team and contribute to our data-driven success!

Responsibilities:

• Develop and maintain web crawlers in Python.
• Crawl large websites and extract data.
• Store data in a database.
• Analyze and report on data.
• Work with other engineers to develop and improve our web crawling infrastructure.
• Stay up to date on the latest crawling tools and techniques.

Required Skills and Qualifications:

• Bachelor's degree in computer science or a related field.
• 2-3 years of experience with Python and web crawling.
• Familiarity with tools / modules such as
• Scrapy, Selenium, Requests, Beautiful Soup etc.
• API tools such as Postman or equivalent. 
• Working knowledge of SQL.
• Experience with web crawling and data extraction.
• Strong problem-solving and analytical skills.
• Ability to work independently and as part of a team.
• Excellent communication and documentation skills.

What we Offer

• Competitive salary

• Medical Benefits/Accident Cover

• Flexi Office Working Hours

• Fast paced start up

• In-depth knowledge in Core Python with Django building end to endapplications development.
• Experience in Web technologies-HTML, CSS, Javascript.

• Database - SQL Server/Postgres/ NoSQL database.
  
  
• Good understanding of Algorithms, data structures.
• Knowledge in ORM (Object Relational Mapper) libraries.
  
  
• Experience in integrating multiple data sources and databases into onesystem.
  
  
• Knowledge in REST / SOAP API
• Knowledge in version control tools like Git
• Experience with various cloud technologies.