11+ Web Scraping Jobs in Ahmedabad | Web Scraping Job openings in Ahmedabad

Position: Lead Python Developer

Location: Ahmedabad, Gujarat

The Client company includes a team of experienced information services professionals who are passionate about growing and enhancing the value of information services businesses. They provide support with talent, technology, tools, infrastructure and expertise required to deliver across the Data ecosystem. Position Summary We are seeking a skilled and experienced Backend Developer with strong expertise in TypeScript, Python, and web scraping. You will be responsible for designing, developing, and maintaining scalable backend services and APIs that power our data-driven products. Your role will involve collaborating with cross functional teams, optimizing system performance, ensuring data integrity, and contributing to the design of efficient and secure architectures.

Job Responsibility

● Design, develop, and maintain backend systems and services using Python and TypeScript.

● Develop and maintain web scraping solutions to extract, process, and manage large-scale data from multiple sources.

● Work with relational and non-relational

databases, ensuring high availability, scalability, and performance.

● Implement authentication, authorization, and security best practices across services.

● Write clean, maintainable, and testable code following best practices and coding standards.

● Collaborate with frontend engineers, data engineers, and DevOps teams to deliver robust solutions and troubleshoot, debug, and upgrade existing applications.

● Stay updated with backend development trends, tools, and frameworks to continuously improve processes.

● Utilize core crawling experience to design efficient strategies for scraping the data from different websites and applications.

● Collaborate with technology teams, data collection teams to build end to end technology-enabled ecosystems and partner in research projects to analyze the massive data inputs.

● Responsible for the design and development of web crawlers, able to independently solve various problems encountered in the actual development process.

● Stay updated with the latest web scraping techniques, tools, and industry trends to continuously improve the scraping processes.

Job Requirements

● 4+ years of professional experience in backend development with TypeScript and Python.

● Strong understanding of TypeScript-based server-side frameworks (e.g., Node.js, NestJS, Express) and Python frameworks (e.g., FastAPI, Django, Flask).

● Experience with tools and libraries for web scraping (e.g., Scrapy, BeautifulSoup, Selenium, Puppeteer)

● Hands-on experience with Temporal for creating and orchestrating workflows

● Proven hands-on experience in web scraping, including crawling, data extraction, deduplication, and handling dynamic websites.

● Proficient in implementing proxy solutions and handling bot-detection challenges (e.g., Cloudflare).

● Experience working with Docker, containerized deployments, and cloud environments (GCP or Azure).

● Proficiency with database systems such as MongoDB and Elastic Search.

● Hands-on experience with designing and maintaining scalable APIs.

● Knowledge of software testing practices (unit, integration, end-to-end).

● Familiarity with CI/CD pipelines and version control systems (Git).

● Strong problem-solving skills, attention to detail, and ability to work in agile environments.

● Great communication skills and ability to navigate in undirected situations.

Job Exposure:

● Opportunity to apply creative methods in acquiring and filtering the North American government, agencies data from various websites, sources

● In depth industry exposure on data harvesting techniques to build, scale the robust and sustainable model, using open-source applications ● Effectively collaboration with IT team to design the tailor-made solutions basis upon clients’ requirement

● Unique opportunity to research on various agencies, vendors, products as well as technology tools to compose a solution 

Job Description :

We are looking for a Full Stack Developer specializing in Angular JS, NodeJS, and React Native, who is extremely hands-on and can take charge of the complete Web Development process to deliver unique & customer-centric web applications.

Skills :

- PRIMARY SKILLS NEEDED: NodeJS, AngularJS, React JS

- MySQL and NoSQL DB (like MongoDB/Cassandra) - MUST HAVE.

- jQuery, JSON, AJAX, web services/REST, SQL.

- JavaScript frameworks like NodeJS, AngularJS, ReactJS, Jasmine or Ember, etc., or JS-based build tools like Grunt, Gulp, and Bower.

- Working knowledge of Apollo, GraphQL, and Moment.js is an advantage.

- UX or UI designing experience is an advantage.

Experience :

- 3+ years of Full Stack Application development experience is a must.

- Deep understanding of client-side development, coding in HTML5, CSS3, JavaScript ES6, and jQuery.

- Strong experience using a client-side MVC framework such as NodeJS, React JS, NextJS, Redux, and AngularJS.

- Topnotch programming skills and writing code for robust software design.

- Experience in responsive design, cross-browser compatibility, and website performance.

- Experience in object-oriented design skills.

- Aggressive problem diagnosis and creative problem-solving skills.

- Experience with Git.

- Experience with handling Services, RESTful, and APIs.

- Knowledge of frontend CSS frameworks like Bootstrap, Material UI, and preprocessors like SASS and LESS.

Responsibilities :

- To work with a cross-functional software development team on highly visible strategic projects as an expert-level individual contributor to the coding tasks assigned.

- Responsible for the development of highly responsive, web-based UI in a flexible and well-structured front-end architecture.

- Experience working with remote data via REST and JSON

- Experience with third-party libraries and APIs (Google APIs etc.)

- Produce well-designed efficient code in a timely manner to meet delivery timescales/milestones.

- Mentor other developers on software best practices and technical guidance and help grow their software development skill sets.

- To proactively stay plugged into emerging technologies/industry trends and apply them to operations and activities.

- Should demonstrate the ability to handle multiple projects simultaneously, manage priorities and communicate progress effectively.

Must Have:

• Thorough experience (Sr. Developer: 3+ years) in core python as well as the Django framework.
• Deep understanding of designing and implementing REST web services/APIs.
• Ability to address authentication and security constraints efficiently.
• Knowledge about Amazon web services and ability to integrate it.
• Ability to write complex python utility scripts.
• Ability to deliver design documentations whenever needed.
• Knowledge of Version Control using SVN/GIT.
• Ability to analyse, debug and resolve basic to complex problems on-demand (independently).

Nice To Have:

• Knowledge with microservice architecture is a BIG plus.
• Knowledge of the docker platform to serve the applications in docker containers and being able to use docker compose will be a plus.
• Leadership and Time Management skills.

Responsibilities:

• Design and develop large scale web applications using Node.js; 
• Full-cycle projects and product development; 
• Focus on software development and build Restful API's; 
• Contribute to the overall software development life-cycle including requirements gathering, analysis, design, development, release/version control, testing, deployment, and support; 
• Be a part of an agile-based team 

Requirements:

• Exposure to ES6 knowledge of REST API Design and Development in Node.js. 
• Basic Knowledge of Web Socket.
• Strong Knowledge of Javascript, Good exposure to Redis, MongoDB.
• Should be having a basic understanding of HTML5, CSS3, Bootstrap4.

We Offer:

• 5 Days Working
• Competitive Salary.
• Knowledge-Based Hierarchy 
• Trending Technology Development
• Career Development Programs.
• Tremendous Scope of Responsibilities and KPIs Aligned with Individual and Organisational Goals.
• Exposure to working with a team size of 65+.
• Good Project Incentives and Rewards.
• Explore Incredible India!Workation Programmes with Airfare, Hotelstay.
• Work-Life Balance.
• Fantastic Team Spirit with Creative, Fun and Open Office Work Culture.

Node.js Developer Requirements:

1. Bachelor's degree in computer science, information science, or similar.

2. At least two years' experience as a Node.js developer.

3. Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.

4. Knowledge of front-end technologies such as HTML5 and CSS3.

5. Superb interpersonal, communication, and collaboration skills.

6. Exceptional analytical and problem-solving aptitude.

7. Great organizational and time management skills.

8. Availability to resolve urgent web application issues outside of business hours.

Roles and Responsibilities :

• Design, Develop, test and maintain software applications with MVC architectures, Microservices and scalable cloud-native apps.
• Perform hands-on coding and provide thoughtful code reviews
• Mentor and lead team members to continuously improve the quality and productivity of deliverables
• Demonstrate ability to work within an agile team as well as collaborate with many other teams on design and implementation strategies. Follow SCRUM Agile Development methodology
• Effective Communication Skills- An ability to express your ideas to the recipient & Co-ordinate and communicate with the cross-functional team along with the client's team
• Problem Solving, Hustler - Get Stuff Done, Self-Disciplined Open-minded, User-Focused, Adaptive
• Lean Principles & Analytical Thinking
• Project planning, timelines and milestones for execution and deliverables
• Participate in the Evaluation Review of your team member

Primary Skills

• Expert in Python with experience on Django.
• Expert in server programming, you should be able to implement complex business logic.
• Good understanding of the threading limitations of Python, and multi-process architecture.
• Good understanding of fundamental design principles behind a scalable application.
• Knowledge of event-driven programming in Python.
• Experience with python packages like Numpy, pandas, flask, Pyspark, pymongo, os, logging, re, pyyaml.
• Experience with swagger io module to expose API
• Strong unit test and debugging skills.
• At least 2 years of experience in RESTful API/HTTP/JSON`
• Knowledge of AWS cloud and python Boto lib.
• Proficient understanding of code versioning tools Like Git.
• Good understanding of Linux OS.

Secondary Skills:

• AWS Kinesis
• Web Sockets
• RAbbitMQ
• AWS Cloud formation

Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application. Therefore, a basic understanding of front-end technologies is necessary as well.

• Integration of user-facing elements developed by front-end developers with server side logic
• Writing reusable, testable, and efficient code
• Design and implementation of low-latency, high-availability, and performant applications
• Implementation of security and data protection

• Strong proficiency with JavaScript & OOPS
• Knowledge of Node.js and frameworks available for it 
• Understanding the nature of asynchronous programming and its quirks and workarounds
• Good understanding of server-side CSS preprocessors 
• Basic understanding of front-end technologies, such as HTML5, and CSS3
• Understanding accessibility and security compliance
• User authentication and authorization between multiple systems, servers, and environments
• Creating database schemas that represent and support business processes
• Implementing automated testing platforms and unit tests
• Proficient understanding of code versioning tools, such as Git
• Knowledge of AWS will be preferable

Our backend(NodeJS+PHP) team is passionate about technology, and we love building scalable web solutions keeping performance in mind.We're looking for a full stack developer that has experience developing a variety of Web Apps using the PHP and NodeJS stack.

Role + Responsibilities:

• Work with the team to design, develop and support scalable applications        
• Developing API’s(REST), designing the database schema and implement same in web frameworks like Laravel and Express along with ORM(including migration script and seeds data)    
• Very good end-to-end debugging skills in PHP and NodejS stack.    
• Write, test, and release production-ready code.        
• Work with our DevOps team to ensure continuous deployments of our applications

Person Specification and Qualifications:

• Experience developing highly scalable services and APIs(in NodejS and PHP frameworks)    
• Knowledge of data modelling and database performance using NoSQL/SQL    
• Strong experience with PHP framework like Laravel(PHP) and JS frameworks like Express, and other Framework In nodeJS.    
• Good knowledge in code versioning(git or svn)    
• Good knowledge in html templating, javascript, html and css.    
• Good experience with code deployment on server like ubuntu, linux.    
• Knowledge of SDK integration(social media sdk like Facebook, google, etc and cloud services sdk like AWS and Azure)    
• Familiarity developing SaaS applications in AWS/Azure cloud services.        
• In-depth knowledge of designing and developing software in distributed architectures for multi-tier applications