11+ Data flow Jobs in Pune | Data flow Job openings in Pune

About the Role

We are looking for a Big Data Engineer with 2–5 years of experience in designing, building, and operating large-scale data processing systems, preferably on Google Cloud Platform

(GCP). This role is suited for engineers who understand modern data architectures and are comfortable working across multiple stages of the data lifecycle.

We do not expect expertise in every GCP data service. Instead, candidates should have

strong hands-on experience in at least one service from each core data area listed below

and the ability to learn and adapt to new tools quickly.

Key Responsibilities

● Design, develop, and maintain scalable data pipelines on GCP.

● Build batch and streaming data processing workflows using managed cloud services.

● Develop and maintain data transformation workflows using SQL and Python.

● Create and manage workflow orchestration using DAG-based schedulers.

● Collaborate with analytics, product, and engineering teams to deliver reliable datasets.

● Optimize data pipelines for performance, cost, and reliability.

● Ensure data quality, monitoring, and observability across pipelines.

● Participate in code reviews and contribute to data engineering best practices.

Core Experience Areas (At Least One From Each)

1. Data Warehousing & Analytics

● BigQuery

● Dataproc (Spark / Hadoop)

● Other cloud data warehouse or analytics platforms

2. Data Processing and Pipelines

● Dataflow (Apache Beam)

● Cloud Run Jobs / Cloud Run Services

● Apache Spark (batch or streaming)

● dbt for transformations

3. Databases & Storage

● Bigtable

● Cloud Storage

● Relational databases (PostgreSQL, MySQL, Cloud SQL)

● NoSQL databases

4. Data Preparation Exploration

● SQL-based data analysis

● Python for data manipulation (Pandas, PySpark)

● Exploratory data analysis on large datasets

Workflow Orchestration & Scheduling

● Cloud Composer (Airflow)

● Cloud Scheduler

● Experience creating and maintaining DAGs in Python

Required Skills & Qualifications

● 2–5 years of experience in data engineering or big data processing.

● Hands-on experience with Google Cloud Platform (preferred).

● Strong proficiency in Python and SQL.

● Understanding of distributed data processing concepts.

● Experience with CI/CD, Git, and production-grade data systems.

● Ability to work across ambiguous problem statements and evolving requirements.

AI & System Mindset

Experience working with AI-powered systems is a strong plus. Candidates should be

comfortable integrating AI agents, third-party APIs, and automation workflows into

applications, and should demonstrate curiosity and adaptability toward emerging AI technologies.

Good to Have

● Experience with streaming data (Pub/Sub, Kafka).

● Cost optimization experience on cloud data platforms.

● Exposure to AI/ML pipelines or feature engineering.

● Experience working in product-driven or startup environments.

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.

Job Title: Java Engineering Manager/Lead

Experience range:- 10 + Years

Location:- Pune / Mumbai

Knowledge and Skills:

• Strong proficiency in Core Java, Spring Boot.
• Experience with RESTful APIs, microservices, and multithreading.
• Solid understanding of RDBMS (MySQL/PostgreSQL).
• Exposure to cloud platforms (AWS, GCP, or Azure) and containerization (Docker, Kubernetes).
• Familiarity with CI/CD tools like Jenkins, GitLab, or GitHub Actions.
• Background in Fintech, particularly Digital Lending, Supply Chain Finance, or Banking products.
• Experience working in agile/scrum environments.
• At least 3 years of experience leading/managing a team of Java developers.

Key Responsibilities:

• Lead and mentor a team of Java developers, ensuring technical excellence and timely delivery.
• Actively participate in coding, code reviews, architecture decisions, and system design.
• Collaborate with cross-functional teams including Product Managers, QA, and DevOps.
• Maintain a strong hands-on presence in backend Java development and microservices architecture.
• Own the end-to-end lifecycle of features from requirement to deployment and post-release support

Job Role: Optimization Engineer - C Programming

Experience: 3 to 8 Years

Location: Bangalore, Pune, Delhi

Were hiring an Optimization Engineer skilled in C Programming and Operations Research / Optimization to design and optimize algorithms solving complex business and engineering problems.

Key Responsibilities:

• Develop and maintain high-performance software using C.
• Build and implement optimization models (linear, integer, nonlinear).
• Collaborate with teams to deliver scalable, efficient solutions.
• Analyze and improve existing algorithms for performance and scalability.

Must-Have Skills:

• Expertise in C Programming and Operations Research / Optimization.
• Strong in data structures, algorithms, and memory management.
• Hands-on with tools like CPLEX, Gurobi, or COIN-OR.
• Python experience is an added advantage.

Preferred Skills:

• Knowledge of Python, C++, or Java.
• Familiarity with AMPL, GAMS, or solver APIs.
• Understanding of HPC, parallel computing, or multi-threading.

Proven experience as an Angular Developer.

Proficient in Angular and its core principles.

Strong knowledge of HTML, CSS, and JavaScript.

Experience with responsive UI design and development.

Familiarity with Angular Material, Bootstrap, and PrimeNG.

Ability to create reusable components and front-end libraries.

Understanding of RESTful APIs and web services.

Experience with version control systems such as Git.

Strong problem-solving skills and attention to detail.

Excellent communication and teamwork skills.

Job Description:

Role: Data Scientist

Responsibilities:

 Lead data science and machine learning projects, contributing to model development, optimization and evaluation. 

 Perform data cleaning, feature engineering, and exploratory data analysis.  

Translate business requirements into technical solutions, document and communicate project progress, manage non-technical stakeholders.

Collaborate with other DS and engineers to deliver projects.

Technical Skills – Must have:

Experience in and understanding of the natural language processing (NLP) and large language model (LLM) landscape.

Proficiency with Python for data analysis, supervised & unsupervised learning ML tasks.

Ability to translate complex machine learning problem statements into specific deliverables and requirements.

Should have worked with major cloud platforms such as AWS, Azure or GCP.

Working knowledge of SQL and no-SQL databases.

Ability to create data and ML pipelines for more efficient and repeatable data science projects using MLOps principles.

Keep abreast with new tools, algorithms and techniques in machine learning and works to implement them in the organization.

Strong understanding of evaluation and monitoring metrics for machine learning projects.

Job Description:

As a Full Stack Developer, your role is to design, develop, and maintain scalable and high-performance web applications using Java and Angular technologies. You will be responsible for both front-end and back-end development, collaborating with cross-functional teams to deliver robust and user-friendly software solutions.

Responsibilities:

• Full Stack Development: Design, develop, test, and deploy web applications using Java, Angular, and related technologies.
• Front-End Development: Create responsive and intuitive user interfaces using HTML, CSS, and JavaScript frameworks like Angular.
• Angular Application Development: Utilize your expertise in Angular to design and develop responsive, efficient, and visually appealing web applications. Collaborate with UX/UI designers to transform wireframes and mockups into fully functional features.
• UI/UX Improvements: Continuously improve the user experience of our applications by identifying and addressing UI/UX issues and proposing innovative solutions to enhance user satisfaction.
• Back-End Development: Develop server-side logic and APIs using Java frameworks like Spring, Spring Boot, or Java EE.
• Database Integration: Design and implement database structures and queries using relational databases like MySQL, PostgreSQL, or Oracle.
• System Architecture: Participate in architectural discussions and provide technical expertise to ensure scalability, performance, and maintainability of the application.
• Code Reviews and Testing: Conduct code reviews to ensure code quality, performance, and adherence to best practices. Write and execute unit tests and participate in integration and system testing.
• Bug Fixing and Maintenance: Identify and resolve defects and performance issues in the application. Provide ongoing support and maintenance of deployed applications.
• Collaboration and Communication: Work closely with cross-functional teams including designers, product managers, and other developers to understand requirements, provide technical insights, and deliver high-quality software solutions.
• Continuous Learning: Keep up to date with emerging technologies and industry trends. Apply new tools and techniques to improve development processes and enhance application performance.

Requirements:

• Proficient in Java programming language and related frameworks like Spring, Spring Boot, or Java EE.
• Strong experience in front-end development using Angular, HTML, CSS, and JavaScript.
• Solid understanding of web application architecture and design patterns.
• Experience with relational databases and SQL queries.
• Familiarity with version control systems like Git and development tools like IDEs and build tools.
• Knowledge of RESTful APIs and web services.
• Basic understanding of containerization technologies (e.g., Docker, Kubernetes).
• Understanding of Agile development methodologies and practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Bachelor's degree in computer science, Software Engineering, or a related field (or equivalent experience).

Preferred Skills:

• Experience with cloud technologies (e.g., AWS, Google Cloud Platform).
• Knowledge of containerization technologies (e.g., Docker, Kubernetes).
• Familiarity with DevOps practices and tools (e.g., Jenkins, Git, CI/CD).
• Experience with test automation frameworks (e.g., JUnit).
• Demonstrable experience in building dynamic web applications using Angular, with in-depth knowledge of Angular 2+ features and concepts.

• 5+ years of software development experience in Java 8+ and Microservices.
• Experience in developing micro services. Experience in developing High Cohesion & Loosely Coupled Micro Services.
• Experienced in skills of requirement, analysis, design, develop, Java, springboot, microservices, rest api, AWS, lambda, EC2, Jenkins, design pattern, spring security, splunk, auth, docker, SOLID
• Hands on experience on Microservices Architecture.
• Should have excellent acumen in Data Structures, algorithms, problem-solving and Logical/Analytical skills. Thorough understanding of OOPS concepts, Design principles and implementation of different type of Design patterns.
• Experience with Multithreading, Concurrent Package and Concurrent APIs
• Basic understanding of Java Memory Management (JMM) including garbage collections concepts.
• Experience in RDBMS or NO SQL databases and writing SQL queries (Joins, group by, aggregate functions, etc.)
• Hands-on experience with Message Broker like Kafka/Rabbitmq or other. Hands-on experience in creating RESTful webservices and consuming web services. Hands-on experience with spring Cloud/Spring Boot.
• Hands-on experience with any of the logging frameworks (SLF4J/LogBack/Log4j)
• Experience of writing Junit test cases using Mockito / Powermock frameworks. Should have practical experience with Maven/Gradle and knowledge of version control systems like Git/SVN etc.
• Hands on experience on Cloud deployment/development like AWS/Azure/GCP.
• Good communication skills and ability to work with global teams to define and deliver on projects. Sound understanding/experience in software development process, test-driven development.

• Gender Neutral /Diversified Culture
• 51 Leaves annually
• Insurance covered for family
• Incentives, Bonus
• Permanent WFH Option
• Generous parental leave and new parent transition program
• Flexible work arrangements