2+ Web Scraping Jobs in Ahmedabad | Web Scraping Job openings in Ahmedabad

Position: Lead Python Developer

Location: Ahmedabad

The Client company includes a team of experienced information services professionals who are

passionate about growing and enhancing the value of information services businesses. They provide

support with talent, technology, tools, infrastructure and expertise required to deliver across the Data ecosystem.

Position Summary

We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python,

and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross-

functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures.

Job Responsibility

● Design, develop, and maintain backend systems and services using Python and TypeScript.

● Develop and maintain web scraping solutions to extract, process, and manage large-scale data from multiple sources.

● Work with relational and non-relational databases, ensuring high availability, scalability, and performance.

● Implement authentication, authorization, and security best practices across services.

● Write clean, maintainable, and testable code following best practices and coding standards.

● Collaborate with frontend engineers, data engineers, and DevOps teams to deliver robust solutions and troubleshoot, debug, and upgrade existing applications.

● Stay updated with backend development trends, tools, and frameworks to continuously improve processes.

● Utilize core crawling experience to design efficient strategies for scraping the data from different websites and applications.

● Collaborate with technology teams, data collection teams to build end to end technology-enabled ecosystems and partner in research projects to analyze the massive data inputs.

● Responsible for the design and development of web crawlers, able to independently solve various problems encountered in the actual development process.

● Stay updated with the latest web scraping techniques, tools, and industry trends to continuously improve the scraping processes.

Job Requirements

● 4+ years of professional experience in backend development with TypeScript and Python.

● Strong understanding of TypeScript-based server-side frameworks (e.g., Node.js, NestJS, Express) and Python frameworks (e.g., FastAPI, Django, Flask).

● Experience with tools and libraries for web scraping (e.g., Scrapy, BeautifulSoup, Selenium, Puppeteer)

● Hands-on experience with Temporal for creating and orchestrating workflows.

● Proven hands-on experience in web scraping, including crawling, data extraction, deduplication, and handling dynamic websites.

● Proficient in implementing proxy solutions and handling bot-detection challenges (e.g., Cloudflare).

● Experience working with Docker, containerized deployments, and cloud environments (GCP or Azure).

● Proficiency with database systems such as MongoDB and ElasticSearch.

● Hands-on experience with designing and maintaining scalable APIs.

● Knowledge of software testing practices (unit, integration, end-to-end).

● Familiarity with CI/CD pipelines and version control systems (Git).

● Strong problem-solving skills, attention to detail, and ability to work in agile environments.

● Great communication skills and ability to navigate in undirected situations.

Job Exposure:

● Opportunity to apply creative methods in acquiring and filtering the North American government, agencies data from various websites, sources

● In depth industry exposure on data harvesting techniques to build, scale the robust and sustainable model, using open-source applications

● Effectively collaboration with IT team to design the tailor-made solutions basis upon clients’ requirement

● Unique opportunity to research on various agencies, vendors, products as well as technology tools to compose a solution

Position: Lead Python Developer

Location: Ahmedabad, Gujarat

The Client company includes a team of experienced information services professionals who are passionate about growing and enhancing the value of information services businesses. They provide support with talent, technology, tools, infrastructure and expertise required to deliver across the Data ecosystem. Position Summary We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python, and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures.

Job Responsibility

● Design, develop, and maintain backend systems and services using Python and TypeScript.

● Develop and maintain web scraping solutions to extract, process, and manage large-scale data from multiple sources.

● Work with relational and non-relational

databases, ensuring high availability, scalability, and performance.

● Implement authentication, authorization, and security best practices across services.

● Write clean, maintainable, and testable code following best practices and coding standards.

● Collaborate with frontend engineers, data engineers, and DevOps teams to deliver robust solutions and troubleshoot, debug, and upgrade existing applications.

● Stay updated with backend development trends, tools, and frameworks to continuously improve processes.

● Utilize core crawling experience to design efficient strategies for scraping the data from different websites and applications.

● Collaborate with technology teams, data collection teams to build end to end technology-enabled ecosystems and partner in research projects to analyze the massive data inputs.

● Responsible for the design and development of web crawlers, able to independently solve various problems encountered in the actual development process.

● Stay updated with the latest web scraping techniques, tools, and industry trends to continuously improve the scraping processes.

Job Requirements

● 4+ years of professional experience in backend development with TypeScript and Python.

● Strong understanding of TypeScript-based server-side frameworks (e.g., Node.js, NestJS, Express) and Python frameworks (e.g., FastAPI, Django, Flask).

● Experience with tools and libraries for web scraping (e.g., Scrapy, BeautifulSoup, Selenium, Puppeteer)

● Hands-on experience with Temporal for creating and orchestrating workflows

● Proven hands-on experience in web scraping, including crawling, data extraction, deduplication, and handling dynamic websites.

● Proficient in implementing proxy solutions and handling bot-detection challenges (e.g., Cloudflare).

● Experience working with Docker, containerized deployments, and cloud environments (GCP or Azure).

● Proficiency with database systems such as MongoDB and Elastic Search.

● Hands-on experience with designing and maintaining scalable APIs.

● Knowledge of software testing practices (unit, integration, end-to-end).

● Familiarity with CI/CD pipelines and version control systems (Git).

● Strong problem-solving skills, attention to detail, and ability to work in agile environments.

● Great communication skills and ability to navigate in undirected situations.

Job Exposure:

● Opportunity to apply creative methods in acquiring and filtering the North American government, agencies data from various websites, sources

● In depth industry exposure on data harvesting techniques to build, scale the robust and sustainable model, using open-source applications ● Effectively collaboration with IT team to design the tailor-made solutions basis upon clients’ requirement

● Unique opportunity to research on various agencies, vendors, products as well as technology tools to compose a solution