11+ Web Scraping Jobs in Ahmedabad | Web Scraping Job openings in Ahmedabad

Position: Lead Python Developer

Location: Ahmedabad, Gujarat

The Client company includes a team of experienced information services professionals who are passionate about growing and enhancing the value of information services businesses. They provide support with talent, technology, tools, infrastructure and expertise required to deliver across the Data ecosystem. Position Summary We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python, and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures.

Job Responsibility

● Design, develop, and maintain backend systems and services using Python and TypeScript.

● Develop and maintain web scraping solutions to extract, process, and manage large-scale data from multiple sources.

● Work with relational and non-relational

databases, ensuring high availability, scalability, and performance.

● Implement authentication, authorization, and security best practices across services.

● Write clean, maintainable, and testable code following best practices and coding standards.

● Collaborate with frontend engineers, data engineers, and DevOps teams to deliver robust solutions and troubleshoot, debug, and upgrade existing applications.

● Stay updated with backend development trends, tools, and frameworks to continuously improve processes.

● Utilize core crawling experience to design efficient strategies for scraping the data from different websites and applications.

● Collaborate with technology teams, data collection teams to build end to end technology-enabled ecosystems and partner in research projects to analyze the massive data inputs.

● Responsible for the design and development of web crawlers, able to independently solve various problems encountered in the actual development process.

● Stay updated with the latest web scraping techniques, tools, and industry trends to continuously improve the scraping processes.

Job Requirements

● 4+ years of professional experience in backend development with TypeScript and Python.

● Strong understanding of TypeScript-based server-side frameworks (e.g., Node.js, NestJS, Express) and Python frameworks (e.g., FastAPI, Django, Flask).

● Experience with tools and libraries for web scraping (e.g., Scrapy, BeautifulSoup, Selenium, Puppeteer)

● Hands-on experience with Temporal for creating and orchestrating workflows

● Proven hands-on experience in web scraping, including crawling, data extraction, deduplication, and handling dynamic websites.

● Proficient in implementing proxy solutions and handling bot-detection challenges (e.g., Cloudflare).

● Experience working with Docker, containerized deployments, and cloud environments (GCP or Azure).

● Proficiency with database systems such as MongoDB and Elastic Search.

● Hands-on experience with designing and maintaining scalable APIs.

● Knowledge of software testing practices (unit, integration, end-to-end).

● Familiarity with CI/CD pipelines and version control systems (Git).

● Strong problem-solving skills, attention to detail, and ability to work in agile environments.

● Great communication skills and ability to navigate in undirected situations.

Job Exposure:

● Opportunity to apply creative methods in acquiring and filtering the North American government, agencies data from various websites, sources

● In depth industry exposure on data harvesting techniques to build, scale the robust and sustainable model, using open-source applications ● Effectively collaboration with IT team to design the tailor-made solutions basis upon clients’ requirement

● Unique opportunity to research on various agencies, vendors, products as well as technology tools to compose a solution 

Job Summary:

Deqode is looking for a highly motivated and experienced Python + AWS Developer to join our growing technology team. This role demands hands-on experience in backend development, cloud infrastructure (AWS), containerization, automation, and client communication. The ideal candidate should be a self-starter with a strong technical foundation and a passion for delivering high-quality, scalable solutions in a client-facing environment.

Key Responsibilities:

• Design, develop, and deploy backend services and APIs using Python.
• Build and maintain scalable infrastructure on AWS (EC2, S3, Lambda, RDS, etc.).
• Automate deployments and infrastructure with Terraform and Jenkins/GitHub Actions.
• Implement containerized environments using Docker and manage orchestration via Kubernetes.
• Write automation and scripting solutions in Bash/Shell to streamline operations.
• Work with relational databases like MySQL and SQL, including query optimization.
• Collaborate directly with clients to understand requirements and provide technical solutions.
• Ensure system reliability, performance, and scalability across environments.

Required Skills:

• 3.5+ years of hands-on experience in Python development.
• Strong expertise in AWS services such as EC2, Lambda, S3, RDS, IAM, CloudWatch.
• Good understanding of Terraform or other Infrastructure as Code tools.
• Proficient with Docker and container orchestration using Kubernetes.
• Experience with CI/CD tools like Jenkins or GitHub Actions.
• Strong command of SQL/MySQL and scripting with Bash/Shell.
• Experience working with external clients or in client-facing roles.

Preferred Qualifications:

• AWS Certification (e.g., AWS Certified Developer or DevOps Engineer).
• Familiarity with Agile/Scrum methodologies.
• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management abilities.

What you'll do:

·         Perform complex application programming activities with an emphasis on mobile development:  Angular, Node, TypeScript, JavaScript, Apache Cordova, RESTful APIs and more

·         Assist in the definition of system architecture and detailed solution design that are scalable and extensible

·         Collaborate with Product Owners, Designers, and other engineers on different permutations to find the best solution possible

·         Own the quality of code and do your own testing. Automate feature testing and contribute UI testing framework

·         Become a subject matter expert for our mobile applications

·         Deliver amazing solutions to production that knock everyone’s socks off

·         Mentor junior developers on the team

What we’re looking for:

·         Amazing technical instincts. You know how to evaluate and choose the right technology and approach for the job. You have stories you could share about what problem you thought you were solving at first, but through testing and iteration, came to solve a much bigger and better problem that resulted in positive outcomes all-around.

·         A love for learning. Technology is continually evolving around us, and you want to keep up to date to ensure we are using the right tech at the right time.

·         A love for working in ambiguity—and making sense of it. You can take in a lot of disparate information and find common themes, recommend clear paths forward and iterate along the way. You don’t form an opinion and sell it as if it’s gospel; this is all about being flexible, agile, dependable, and responsive in the face of many moving parts.

·         Confidence, not ego. You have an ability to collaborate with others and see all sides of the coin to come to the best solution for everyone.

·         Flexible and willing to accept change in priorities, as necessary

Basic Qualifications: 

·         Minimum B.S. / M.S. Computer Science or related discipline from accredited college or University

·         At least 6 years of experience designing, developing, and delivering web applications with Angular, Node, Typescript, IONIC and JavaScript

·         At least 2 years of experience building iOS-based applications utilizing hybrid technologies

·         At least 2 years of experience with AWS and/or Openshift

·         Experience integrating with native device API’s (iOS)

·         Experience with front-end and/or mobile-specific testing frameworks

·         Strong experience in object-oriented design and development

·         Knowledge of building and consuming RESTful APIs

·         Excellent sense of web design, passionate about creating and refining great mobile user experiences.

·         Ability to manage multiple tasks and consistently meet established timelines   

·         Strong collaboration skills

·         Excellent written and verbal communications skills

Preferred Qualifications:

·         Proficient with Apache Cordova framework

·         Built or maintained custom Cordova plugin

• Demonstrable knowledge of native coding background in iOS

·         Understanding of Apple certificate and profile management

·         Experience developing and deploying applications within Kubernetes based containers

·         Experience in Agile and SCRUM development techniques

Experience: 3-5 Years Experience

Skills:

Javascript, Node JS, HTML, CSS, Advanced JS

 Location : Ahmedabad 

Skills And Qualifications

• Expert in Python, with knowledge of at least one Python web framework (such as Django, Flask, etc depending on your technology stack)
• Familiarity with some ORM (Object Relational Mapper) libraries
• Able to integrate multiple data sources and databases into one system
• Understanding of the threading limitations of Python, and multi-process architecture
• Good understanding of server-side templating languages (such as Jinja 2, Mako, etc depending on your technology stack)
• Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3
• Understanding of accessibility and security compliance (depending on the specific project)
• Knowledge of user authentication and authorization between multiple systems, servers, and environments
• Understanding of fundamental design principles behind a scalable application
• Familiarity with event-driven programming in Python
• Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform
• Able to create database schemas that represent and support business processes
• Strong unit test and debugging skills
• Proficient understanding of code versioning tools (such as Git, Mercurial or SVN)
• (Make sure to mention other frameworks, libraries, or any other technology related to your development stack)
• (List education level or certification you require)

Roles & Responsibilities:

• Excellent problem-solving & analytical skills & OO principles
• Solid understanding of the data structure & algorithms.
• Expert knowledge with any one of the Javascript Framework such as Node Js.
• Any additional experience with Java or python, GoLang would be nice to have.
• Experience working with SQL database like MySQL or PostgreSQL
• Experience working with NoSQL databases like mongoDB, couchbase would be nice to have
• Working experience with cache like redis, mem cached or elasticache would be nice to have
• Working experience with Message Queues would be a great advantage.
• Experience with deployment & AWS would be nice to have
• Ability to do in depth analysis or problem statement or use case & Build robust & scalable architecture
• Logging & monitoring of the production system in real time
• Lead a team of 2-4 team members & make sure team practices defined coding practices across the project. 

Following are the things that we are looking for in our NodeJS developer:

• Full SDLC knowledge, preferably in an agile environment.
• Strong written and verbal communication skills. Strong critical thinking & problem solving skills.
• Understanding of Unix / Linux based systems.
• Hands-on exposure to deeply linked relational databases – preferably in MySQL
• Ability to take a feature or product through the full Software Development Life Cycle.
• Strong communication skills, including the ability to both collaborate well and also the ability to convey technical ideas and concepts to non-technical stakeholders.
• Identify the interaction needs and how the API. must be developed based on design comps, product specs, etc.
• Continuously evaluate and implement new technologies to maximize development efficiency.
• Address and prioritize production level bugs and application performance improvements.
• An adaptable attitude and understanding of the agile methodology.
• Unit-test code for robustness, including edge cases, usability, and general reliability.
• Collaborate with cross-functional teams to define, design, and release new features.

Azine Technologies is known for our innovative technologies, products and services -- and for the people behind them. At Azine, we create identity verification products which are essentially apps, APIs, SDKs which have different modules that undergo OCR, Face Recognition, and other AI and machine learning. We’re looking for a Python Developer who can fulfil the following responsibilities.

• Design & implement new software modules based on the product requirements
• Debug existing software components, fix issues and avoid regressions
• Be proactive, take ownership and be accountable
• Familiar with Test Drive Development.
• Participate in software architecture, design discussions and code reviews

Bachelor’s degree and 3+ years of software development experience or equivalent, including Computer Vision and AI/ML.

Understanding of OCR, Neural network and Deep learning.

Expert in Python with knowledge of Python Frameworks (such as Django, Flask, etc.).

Expert understanding of threading and limitations of Python, and multi-process architecture.

Knowledge of user authentication and authorization between multiple systems, servers, and environments.

Proficient understanding with code versioning tools such as Git, SVN, etc.

Strong unit test and debugging skills.

Basic understanding of front-end technologies, such as Javascript, HTML5, and CSS3.

Django, Flask, Neural networks, Deep Learning, Optical character recognition, Self-organizing maps, Artificial Intelligence (AI), Machine Learning (ML), Software architecture, Celery, Object-relational mapping, NOSQL Databases, MongoDB, Computer Vision, GANs,

We are offering amazing career growth opportunities, great compensation, and benefits. This begins with: weekly lunches, alternate weekends-off, annual medical checkups, social engagement, financial assistance and more.

Job Type: Full-time

Location: Iscon, Ahmedabad