
Software Engineer
at Service company, helps businesses harness the power of data
About the Company:
It is a Data as a Service company that helps businesses harness the power of data. Our technology fuels some of the most interesting big data projects of the word. We are a small bunch of people working towards shaping the imminent data-driven future by solving some of its fundamental and toughest challenges.
Role: We are looking for an experienced team lead to drive data acquisition projects end to end. In this role, you will be working in the web scraping team with data engineers, helping them solve complex web problems and mentor them along the way. You’ll be adept at delivering large-scale web crawling projects, breaking down barriers for your team and planning at a higher level, and getting into the detail to make things happen when needed.
Responsibilities
- Interface with clients and sales team to translate functional requirements into technical requirements
- Plan and estimate tasks with your team, in collaboration with the delivery managers
- Engineer complex data acquisition projects
- Guide and mentor your team of engineers
- Anticipate issues that might arise and proactively consider those into design
- Perform code reviews and suggest design changes
Prerequisites
- Between 2-3 years of relevant experience
- Fluent programming skills and well-versed with scripting languages like Python or Ruby
- Solid foundation in data structures and algorithms
- Excellent tech troubleshooting skills
- Good understanding of web data landscape
- Prior exposure to DOM, XPATH and hands on experience with selenium/automated testing is a plus

Similar jobs
Job Title : Python Django Developer
Experience : 6+ Years
Location : Gurgaon (Work from Office)
Job Type : Full-time
Working Days: Monday to Friday (5 Days)
Timings: 9:30 AM – 6:30 PM
Job Summary :
We are seeking a highly skilled and experienced Python Django Developer to join our dynamic team in Gurgaon.
The ideal candidate will have a strong background in backend development, Django frameworks, and RESTful API integration.
You will be responsible for building and maintaining scalable web applications and collaborating with cross-functional teams.
Key Responsibilities :
- Develop, test, and maintain robust, scalable, high-performance web applications using Django and Python.
- Design and implement RESTful APIs and integrate third-party APIs and services.
- Write reusable, testable, and efficient code following best practices and coding standards.
- Work with frontend developers to integrate user-facing elements using server-side logic.
- Optimize applications for maximum speed and scalability.
- Perform code reviews, troubleshoot issues, and ensure application performance and security.
- Collaborate with product managers, designers, and other developers to deliver high-quality products.
Required Skills & Qualifications :
- 6+ Years of hands-on experience with Python and Django framework.
- Strong experience with RESTful APIs, Django ORM, and PostgreSQL/MySQL.
- Proficiency in version control systems like Git.
- Familiarity with frontend technologies such as HTML, CSS, JavaScript, and AJAX.
- Experience with Docker, Celery, Redis, and cloud platforms (AWS/Azure) is a plus.
- Solid understanding of software development principles and design patterns.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration abilities.
Good to Have :
- Experience with Django REST Framework (DRF).
- Knowledge of unit testing and CI/CD pipelines.
- Exposure to Agile development methodologies.
- Familiarity with containerization and deployment tools (Docker, Kubernetes).
Role: Core infrastructure for two global applications.
Key responsibilities:
Heavy Data Lifting: Designing and maintaining complex MongoDB aggregation pipelines and executing high-volume bulk updates.
Systems Connectivity: Managing the lifecycle of Bridges, WebSockets, and REST APIs for global traffic.
Global Reliability: Troubleshooting performance regressions, managing SSL/TLS certificates, and optimizing AWS S3/EC2 resources.
Core Logic: Implementing server-side push notifications, custom payment flows, and background Cron orchestration.
Requirements (Must Have)
Production Experience: Proven experience managing backend services for live, high-traffic applications. (Must have)
Note: Learning projects, bootcamps, and online courses will not be considered.
Python Mastery: Expert-level proficiency in backend Python development. (Must have)
MongoDB Expertise: Deep knowledge of Aggregations and Bulk operations. (Must have)
AWS Proficiency: Direct experience with S3 and EC2 in a production setting. (Must have)
Infrastructure Logic: Ability to manage SSL/Encryption and optimize resource allocation (Cron vs. API). (Must have)

Job Details
- Job Title: Lead Software Engineer - Java, Python, API Development
- Industry: Global digital transformation solutions provider
- Domain - Information technology (IT)
- Experience Required: 8-10 years
- Employment Type: Full Time
- Job Location: Pune & Trivandrum/ Thiruvananthapuram
- CTC Range: Best in Industry
Job Description
Job Summary
We are seeking a Lead Software Engineer with strong hands-on expertise in Java and Python to design, build, and optimize scalable backend applications and APIs. The ideal candidate will bring deep experience in cloud technologies, large-scale data processing, and leading the design of high-performance, reliable backend systems.
Key Responsibilities
- Design, develop, and maintain backend services and APIs using Java and Python
- Build and optimize Java-based APIs for large-scale data processing
- Ensure high performance, scalability, and reliability of backend systems
- Architect and manage backend services on cloud platforms (AWS, GCP, or Azure)
- Collaborate with cross-functional teams to deliver production-ready solutions
- Lead technical design discussions and guide best practices
Requirements
- 8+ years of experience in backend software development
- Strong proficiency in Java and Python
- Proven experience building scalable APIs and data-driven applications
- Hands-on experience with cloud services and distributed systems
- Solid understanding of databases, microservices, and API performance optimization
Nice to Have
- Experience with Spring Boot, Flask, or FastAPI
- Familiarity with Docker, Kubernetes, and CI/CD pipelines
- Exposure to Kafka, Spark, or other big data tools
Skills
Java, Python, API Development, Data Processing, AWS Backend
Skills: Java, API development, Data Processing, AWS backend, Python,
Must-Haves
Java (8+ years), Python (8+ years), API Development (8+ years), Cloud Services (AWS/GCP/Azure), Database & Microservices
8+ years of experience in backend software development
Strong proficiency in Java and Python
Proven experience building scalable APIs and data-driven applications
Hands-on experience with cloud services and distributed systems
Solid understanding of databases, microservices, and API performance optimization
Mandatory Skills: Java API AND AWS
******
Notice period - 0 to 15 days only
Job stability is mandatory
Location: Pune, Trivandrum
Good to have knowledge of AWS, prometheus, kubernetes and other monitoring tools.
Min exp 1 year. Must be from Pune since we are not able to provide relocation.
Key Responsibilities
- Develop and maintain Python-based applications.
- Design and optimize SQL queries and databases.
- Collaborate with cross-functional teams to define, design, and ship new features.
- Write clean, maintainable, and efficient code.
- Troubleshoot and debug applications.
- Participate in code reviews and contribute to team knowledge sharing.
Qualifications and Required Skills
- Strong proficiency in Python programming.
- Experience with SQL and database management.
- Experience with web frameworks such as Django or Flask.
- Knowledge of front-end technologies like HTML, CSS, and JavaScript.
- Familiarity with version control systems like Git.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
Good to Have Skills
- Experience with cloud platforms like AWS or Azure.
- Knowledge of containerization technologies like Docker.
- Familiarity with continuous integration and continuous deployment (CI/CD) pipelines
We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.
Key Responsibilities:
- Design, develop, test, and maintain scalable ETL data pipelines using Python.
- Work extensively on Google Cloud Platform (GCP) services such as:
- Dataflow for real-time and batch data processing
- Cloud Functions for lightweight serverless compute
- BigQuery for data warehousing and analytics
- Cloud Composer for orchestration of data workflows (based on Apache Airflow)
- Google Cloud Storage (GCS) for managing data at scale
- IAM for access control and security
- Cloud Run for containerized applications
- Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
- Implement and enforce data quality checks, validation rules, and monitoring.
- Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
- Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
- Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
- Document pipeline designs, data flow diagrams, and operational support procedures.
Required Skills:
- 4–8 years of hands-on experience in Python for backend or data engineering projects.
- Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
- Solid understanding of data pipeline architecture, data integration, and transformation techniques.
- Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
- Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).
1: proficient in python, flask, pandas, GitHub and AWS
2: good knowledge of databases both SQL and NoSQL
3:Strong experience in REST and SOAP APIs
4: Experience with working on scalable interactive web applications
5:Basic knowledge of JavaScript and Html
6: Automation and crawling tools and modules
7: Multithreading and Multiprocessing
8:Good Understanding of test-driven Development
9: Preferred exposure to finance domain
We’re a small team looking for passionate, execution-focused, self-starters to help us build the next generation eCommerce platform and equal the playing field for all. Our success depends on building teams who can challenge each other's assumptions with fresh perspectives. To that end, we don’t just accept differences – we celebrate them. If that sounds exciting to you, let’s talk!
We are expanding our Engineering team to India and building a stellar and diverse team composed of owners. We are looking for a backend engineer with a demonstrated track record of developing and maintaining production services, innovative thinking, and technical excellence. As a backend engineer, you will be responsible for building out the service layer that powers our frontend applications. You should have a solid understanding of software development lifecycle and software design principles. This is a great opportunity if you are looking for a huge impact at a small start-up with immense growth potential.
What you will do?
Create technical plans of projects assigned to you.
Come up with well-structured solutions to ambiguous problems and implement them.
Ship high-quality, well-tested, secure, and maintainable backend code.
Provide technical direction on our various products and upcoming projects.
Champion reliability and quality by using best practices in software engineering and modular design.
Ensure all components are scalable, maintainable, and have in-built metrics instrumentation and monitoring
Deliver an exceptional user experience to our customers. Put the customer first and have quality in mind.
Own the full release cycle from development to deployment.
What you will need?
3+ Years of experience as a software engineer working on backend applications.
Advanced knowledge of Python (preferably, the Django framework) and relational databases.
Experience with agile, test-driven development, continuous integration, and automated testing.
Experience with building, modifying, and extending API endpoints (REST or GraphQL) for data retrieval and persistence.
Experience with the full software development life cycle, including requirements collection, design, implementation, testing, and operational support.
Excellent verbal and written communication, teamwork, decision making and influencing skills.
Experience with scrum or other agile software development methodology.
Hustle. Thrives in an evolving, fast-paced, ambiguous work environment.
Bonus if you have
Experience working in the eCommerce domain.
Experience with AWS technologies like Elastic Beanstalk, Amplify, etc.











