Senior Flink developer at codersbrain · Bengaluru (Bangalore) · 10 - 18 years · Bootstrapped · Posted 25 Jul 2023
1. Flink Sr. Developer
Location: Bangalore(WFO)
Mandatory Skills & Exp -10+ Years : Must have Hands on Experience on FLINK, Kubernetes , Docker, Microservices, any one of Kafka/Pulsar, CI/CD and Java.
Job Responsibilities:
As the Data Engineer lead, you are expected to engineer, develop, support, and deliver real-time
streaming applications that model real-world network entities, and have a good understanding of the
Telecom Network KPIs to improve the customer experience through automation of operational network
data. Real-time application development will include building stateful in-memory backends, real-time
streaming APIs , leveraging real-time databases such as Apache Druid.
Architecting and creating the streaming data pipelines that will enrich the data and support
the use cases for telecom networks
Collaborating closely with multiple stakeholders, gathering requirements and seeking
iterative feedback on recently delivered application features.
Participating in peer review sessions to provide teammates with code review as well as
architectural and design feedback.
Composing detailed low-level design documentation, call flows, and architecture diagrams
for the solutions you build.
Running to a crisis anytime the Operations team needs help.
Perform duties with minimum supervision and participate in cross-functional projects as
scheduled.
Skills:
Flink Sr. Developer, who has implemented and dealt with failure scenarios of
processing data through Flink.
Experience with Java, K8S, Argo CD/Workflow, Prometheus, and Aether.
Familiarity with object-oriented design patterns.
Experience with Application Development DevOps Tools.
Experience with distributed cloud-native application design deployed on Kubernetes
platforms.
Experience with PostGres, Druid, and Oracle databases.
Experience with Messaging Bus - Kafka/Pulsar
Experience with AI/ML - Kubeflow, JupyterHub
Experience with building real-time applications which leverage streaming data.
Experience with streaming message bus platforming, either Kafka or Pulsar.
Experience with Apache Spark applications and Hadoop platforms.
Strong problem solving skills.
Strong written and oral communication skills.

About codersbrain
About
Connect with the team
Similar jobs (10)

SDE3 – Data Platform Engineer
Experience: 5–10 Years
Employment Type: Contract-to-Hire (3 Months)
Location: Remote initially | Pune after conversion
About the Role
We are looking for an experienced SDE3 – Data Platform Engineer with strong backend development and data engineering expertise.
The ideal candidate should have excellent programming skills in Java (preferred), Golang, or Python, along with hands-on experience building scalable data platforms, distributed systems, and data pipelines.
Key Responsibilities
- Design and develop scalable backend and data platform solutions.
- Build and optimize ETL/ELT pipelines and data ingestion systems.
- Develop APIs and backend services for data infrastructure.
- Work with Kafka, Spark, Airflow, BigQuery, and Redshift.
- Handle large-scale data processing and distributed systems.
- Optimize application performance, scalability, and reliability.
- Collaborate with engineering teams to deliver production-grade solutions.
Required Skills
- Strong programming in Java, Golang, or Python (Java preferred).
- Backend development and API development.
- Data pipelines, ETL/ELT, and data ingestion.
- Strong SQL and data modeling.
- Kafka, Spark, Airflow, BigQuery, or Redshift.
- Distributed systems and system design.
- Docker, Kubernetes, and CI/CD fundamentals.
Ideal Candidate
- Strong Backend + Data Engineering background.
- Experience building scalable data platforms.
- Excellent coding and problem-solving skills.
- Experience handling high-volume data processing.
Note: Pure Data Engineers, BI/Analytics professionals, and candidates with only SQL reporting or basic ETL experience are not suitable.
Work Arrangement
- Initial 3-month contractual period – Remote.
- Conversion based on performance.
- Post-conversion – 5 days WFO from Pune.

Role Overview
We are looking for a Lead Java Backend Engineer with strong experience in Apache Kafka and Kafka Streams, along with Java, Spring Boot, and Microservices. The candidate will build and support scalable, event-driven backend applications and work with containerization and cloud technologies.
Required Skills
Java
Spring Boot
Microservices architecture
Apache Kafka — topics, partitions, producers, consumers, and message-processing guarantees
Kafka Streams — stream processing, joins, windowing, and stateful aggregations
Docker
Kubernetes
AWS
Key Responsibilities
Develop and maintain backend services using Java, Spring Boot, and Microservices.
Build and support event-driven applications using Apache Kafka and Kafka Streams.
Design and maintain Kafka topics, partitions, producers, and consumers based on application needs.
Implement stream-processing logic, including joins, windowing, and aggregations.
Troubleshoot performance, reliability, and message-processing issues in distributed applications.
Package and deploy applications using Docker and Kubernetes, and support deployments on AWS.
Collaborate with engineering teams to deliver reliable, scalable backend solutions.
This job is Remote India only

Hiring: Data Engineer – Java / Scala
Experience: 4–10 Years
Location: Bangalore
Mandatory Skills: Java, Scala, Spring Boot, Microservices, REST API, SQL, Git, Testing.
Job Description:
Looking for an experienced Data Engineer with strong Java/Scala development skills and experience in building scalable backend applications and data platforms.
Candidates should have hands-on experience with Spring Boot, Microservices, REST APIs, SQL, Git and Testing. Knowledge of data engineering, data architecture, Databricks, Snowflake and cloud platforms (AWS/Azure/GCP) is preferred.

We are hiring for a Data Engineer & Java scala for a full-time opportunity in Bangalore.
Experience: 4–10 Years
Must-Have Skills:
Java / Scala / Python, Data Engineering, Databricks / Snowflake, and Cloud (AWS / Azure / GCP).
We are looking for strong software engineers with hands-on experience in data platform development, scalable backend programming, data integration, and cloud technologies.
Experience in Banking, Capital Markets, Market Risk, or Regulatory Reporting will be an added advantage.

Job Title : Data Platform Engineer (SDE 2 / SDE 3)
Experience : 3 to 8 Years (SDE2 : 3 to 5 Years | SDE3 : 5.5 to 8 Years)
Location : Remote (Contract) → Pune (Post Conversion)
Employment Type : Contract-to-Hire (3 Months)
Mandatory Skills :
Java / Python / Go, SQL, Data Engineering, ETL / ELT, Apache Airflow, Apache Spark / Flink, Kafka, AWS/GCP/Azure, Distributed Systems, API Development, Docker, Kubernetes, CI/CD, System Design
Role Overview :
We are looking for a Data Platform Engineer with strong backend engineering expertise to build scalable, high-performance data platforms and distributed systems. The ideal candidate should have hands-on experience in developing production-grade backend applications along with designing and maintaining modern data pipelines.
Key Responsibilities :
- Build and maintain scalable ETL/ELT and data processing pipelines.
- Develop backend services and APIs using Java (preferred), Python, or Go.
- Design batch and real-time data pipelines using Spark, Flink, Kafka, and Airflow.
- Optimize SQL queries, data models, and distributed data systems.
- Work with cloud platforms (AWS, GCP, or Azure) and container technologies (Docker, Kubernetes).
- Implement CI/CD, monitoring, logging, and performance optimization.
- Collaborate with product and engineering teams on scalable system design and architecture.
Required Qualifications :
- SDE 2 : 3 to 5 years of Backend + Data Engineering experience.
- SDE 3 : 5.5 to 8 years of Backend + Data Engineering experience.
- Strong coding skills in Java (preferred), Python, or Go.
- Excellent SQL and data modeling knowledge.
- Hands-on experience with Airflow, Apache Spark / Apache Flink, or similar technologies.
- Experience building scalable backend services and APIs.
- Good understanding of distributed systems, system design. and scalable architecture.
- Experience with cloud platforms (AWS, Azure, or GCP).
- Hands-on experience with Docker and Kubernetes.
- Strong understanding of CI/CD pipelines.
- Excellent problem-solving and debugging skills.
Good to Have :
- Experience with Snowflake, BigQuery, or Redshift.
- Understanding of Kafka, Kinesis, or Pub/Sub
- Performance optimization of large-scale distributed systems
- FinTech or high-scale distributed systems experience.
- Knowledge of data governance, security, and compliance.
Preferred Candidate Profile :
- Strong Backend + Data Engineering experience
- Experience building scalable production systems
- Strong ownership mindset
- Good system design knowledge
- Experience processing millions of events using Kafka/Spark
- Built APIs supporting data infrastructure
- Production engineering experience
Interview Process :
- Take-home Coding Assignment (48 Hours)
- Leadership & Strategy Round (1 Hour)
- Technical Depth – Data Engineering & Performance (1 Hour)
- Culture & Values Fit (30 Minutes)
Job Title : Senior Data Engineer – GCP & Apache Spark
Job Details :
- Number of Positions : 3
- Employment Type : Contract-to-Hire (C2H)
- Experience Required : 5 to 8 Years
- Location : Manyata Tech Park, Bengaluru
- Work Mode : Hybrid – 3 Days in Office per Week
- Preferred Notice Period : Immediate to 15–20 Days
- Project Duration : Initially 6–8 months, with a strong possibility of extension for long-term projects
- Relocation : Candidates from outside Bengaluru can apply if they are willing to relocate.
Role Overview :
We are looking for experienced Senior Data Engineers with strong expertise in Google Cloud Platform (GCP), Apache Spark, BigQuery, and SQL to design, develop, and maintain scalable data pipelines and distributed data processing solutions.
The ideal candidate should have hands-on experience with cloud-based data engineering, end-to-end pipeline architecture, system design, performance optimization, debugging, and CI/CD practices.
Mandatory skills :
Apache Spark (PySpark / Scala), SQL, GCP, BigQuery, GCP Dataproc, Data Pipelines, System Design, CI/CD, Debugging & Problem-Solving.
Key Responsibilities :
- Design, develop, and maintain scalable data pipelines using Apache Spark, PySpark, and/or Scala.
- Build and optimize batch and distributed data processing workflows on GCP.
- Work extensively with BigQuery for data transformation, validation, analytics, and query optimization.
- Develop and maintain data workflows using GCP services, including Dataproc, BigQuery, and Cloud Storage.
- Design end-to-end data pipeline architectures with a focus on scalability, reliability, and performance.
- Write and optimize complex SQL queries for large-scale datasets.
- Troubleshoot and resolve data processing issues, pipeline failures, and performance bottlenecks.
- Implement CI/CD practices for data engineering workflows, testing, and deployments.
- Monitor pipeline performance and identify opportunities for continuous improvement.
- Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
- Participate in code reviews, testing, production deployments, and production support.
Mandatory Skills :
- Strong hands-on experience with Apache Spark, including PySpark and/or Scala.
- Strong SQL skills and experience working with large-scale datasets.
- Hands-on experience with Google Cloud Platform (GCP).
- Practical experience with BigQuery and data warehousing concepts.
- Working knowledge of GCP Dataproc.
- Strong understanding of data pipelines, end-to-end workflows, and system design.
- Practical experience with CI/CD and deployment processes.
- Excellent debugging, troubleshooting, and problem-solving skills.
Preferred Skills :
- Experience with Apache Airflow, Google Cloud Composer, or similar orchestration tools.
- Knowledge of Kafka or other streaming and messaging technologies.
- Proficiency in Python for data engineering and automation.
- Experience with Git-based development workflows.
- Knowledge of Linux/Unix environments and shell scripting.
- Familiarity with monitoring, logging, data quality, and governance practices.
Required Qualifications :
- 5 to 8 years of experience in Data Engineering, Big Data Engineering, or a related field.
- Proven experience developing and maintaining scalable data pipelines.
- Strong understanding of distributed data processing and cloud-based data architecture.
- Ability to troubleshoot complex technical issues and optimize pipeline performance.
- Strong communication, collaboration, and ownership skills.
Interview Process :
Round 1 : AI-Based Interview
- Candidates must complete the AI interview as soon as possible after receiving the invitation.
Round 2 : Virtual Interview Drive
- Interviews are planned for the upcoming drive; exact dates will be communicated separately.
Round 3 : Online Client Interview
- Shortlisted candidates will attend the online interview.
- Candidates must be available throughout the day on the scheduled interview date.
Experience: 8+ years (including 5+ years hands-on with Apache Kafka platform engineering)
Key Responsibilities
• Manage Kafka cluster lifecycle: provisioning, configuration tuning, upgrades, and decommissioning
• Deploy, operate, and maintain Kafka on Kubernetes using Confluent for Kubernetes (CFK)
• Monitor cluster health and set up alerting across consumer lag, broker health, and topic throughput
• Design and operate disaster recovery and multi-region replication strategies
• Enforce Kafka security policies including access reviews and ACL management
• Troubleshoot performance bottlenecks, consumer lag issues, and broker failures
Must Have
• 8+ years in messaging/streaming platform engineering, with 5+ years on Apache Kafka platform engineering
• Hands-on administration of self-managed on-premises Kafka clusters in KRaft mode
• Confluent for Kubernetes (CFK): operator management and custom resource configuration
• Kafka Connect: connector lifecycle, SMTs, and error handling
• Confluent Schema Registry; schema evolution and compatibility modes
• Kafka security: TLS/mTLS, SASL, and ACL configuration and troubleshooting
• Proficiency in Java or Scala; Python for scripting and tooling
• Observability: Prometheus, Grafana, and OpenTelemetry
Good to Have
• Apache Flink for complex event processing beyond Kafka Streams
• CDC pipelines into Kafka
• Operational experience with MirrorMaker 2 or Confluent Replicator in multi-DC setups
• Knowledge of event-driven architecture or data mesh principles
• Build and maintain infrastructure-as-code for Kafka resources
• Integrate Kafka platform changes with CI/CD pipelines for topic and schema deployments
Technical Stack
- PySpark
- Databricks
- Microsoft Azure
- SQL
- Kubernetes
Key Responsibilities & Expectations
- Must be self-driven, proactive, and capable of independently delivering high-quality solutions.
- Demonstrate strong ownership and accountability for assigned tasks and deliverables.
- Ability to work with minimal supervision while consistently meeting project objectives and quality standards.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Python and PySpark.
- Work extensively with Databricks and Delta Lake, including Delta tables, MERGE operations, schema evolution, Time Travel, and data optimization.
- Develop, schedule, and monitor Apache Airflow DAGs for workflow orchestration and dependency management.
- Work with Kubernetes for containerized application deployment, orchestration, monitoring, and troubleshooting.
- Develop reusable and optimized Python code following software engineering best practices.
- Optimize Spark jobs for performance, scalability, and cost efficiency.
- Implement data quality checks, error handling, logging, and monitoring mechanisms.
- Use Git for version control, branching, pull requests, code reviews, and collaborative development.
- Troubleshoot pipeline failures, investigate data issues, and implement reliable solutions.
- Collaborate with cross-functional teams to understand business requirements and deliver efficient data solutions.
Required Technical Skills
- Python: Strong programming skills, including data manipulation, exception handling, modular programming, and debugging.
- PySpark: Hands-on experience with Spark DataFrames, Spark SQL, joins, transformations, partitioning, and performance tuning.
- Databricks: Strong understanding of Databricks architecture, notebooks, workflows, compute management, and job execution.
- Delta Lake: Experience with Delta tables, ACID transactions, MERGE/UPSERT, schema enforcement, schema evolution, VACUUM, and Time Travel.
- Apache Airflow: Experience developing DAGs, managing task dependencies, configuring retries, scheduling workflows, and troubleshooting failures.
- Kubernetes: Practical knowledge of pods, deployments, services, ConfigMaps, Secrets, resource management, and troubleshooting containerized workloads.
- Git: Proficiency in branching strategies, pull requests, merging, and resolving conflicts.
- SQL: Strong SQL skills, including complex joins, CTEs, window functions, and query optimization.
Good to Have
- Experience with Docker and containerization best practices.
- Experience with Databricks Unity Catalog and data governance.
- Knowledge of CI/CD pipelines and automated deployments.
- Experience deploying and managing Airflow workloads on Kubernetes.
- Familiarity with Kubernetes monitoring, autoscaling, and resource optimization.
- Experience with cloud platforms such as Azure, AWS, or GCP.
- Understanding of data lakehouse architecture and data modeling.
- Experience with batch and incremental data processing.
- Familiarity with data quality frameworks and automated testing.
Preferred Candidate Profile
- Strong analytical and problem-solving skills.
- Ability to independently design, develop, deploy, and troubleshoot data pipelines.
- Good understanding of distributed data processing and container orchestration.
- Experience working in an Agile development environment.
- Strong communication and collaboration skills.
1. Company Description:
Tatvic, is a marketing analytics company focusing on generating insights from data using long association with Google & its infrastructure. We breed,recognize and reward performance. As a company we are growing very fast & we are under transformation. To enable this transformation we need future leaders with eyesight which balances execution & strategic understanding.
Website: www.tatvic.com
2. Role Details
- Role: Lead Data Engineer
- Band: L4
- Department: Data Engineering
- Reporting to: L5 / Head of Delivery
- Location: Ahmedabad
- Job Type: Full Time
- Experience: 6-8 years of relevant experience
- Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related technical field.
3. Mission & Role Overview
- Mission: To create high-level organizational impact by leading a team to design and deliver scalable, high-performance cloud-native data solutions. The Lead Data Engineer (L4) is responsible for ensuring technical excellence—specifically in BigQuery optimization and secure GCP/AWS architectures—while driving the transition to Agentic AI workflows and creating value through the development of L1-L3 engineers.
- Role Overview: This is a pivotal leadership role on the Management Track, responsible for end-to-end data outcomes for the function. The Lead Engineer ensures the quality of engineering execution, manages team utilization and resource allocation, and serves as the primary technical representative in cross-functional forums with Marketing, Strategy, and Product teams.
4. Key Responsibilities
- Lead the design, development, and deployment of scalable and efficient cloud-based data pipelines and architectures.
- Build reusable data solutions and software components that serve multiple customers and use cases.
- Architect cloud environments using GCP, ensuring best practices in IAM, Security, and Networking.
- Conduct Exploratory Data Analysis (EDA) on clickstream and behavioral datasets to derive insights.
- Manage end-to-end ETL processes, including data extraction, transformation, and loading using Python, SQL, and Airflow.
- Design and build production-grade software (APIs, services, internal tools) with sound engineering practices — version control, testing, CI/CD, and code review.
- Extend data platforms with AI capabilities — integrating LLMs, RAG pipelines, and agentic workflows where they add clear business value.
- Perform Root Cause Analysis (RCA) and resolve data quality, pipeline, or application issues.
- Collaborate cross-functionally with Marketing, Insights, Product, and Engineering teams to align data initiatives with business goals.
- Document architectures, design decisions, and operations clearly and consistently.
- Coach and mentor team members, ensuring technical excellence and continuous learning.
- Participate in recruitment and knowledge-sharing through interviews, blogs, and webinars.
5. Must-Have & Good-to-Have Skills
Must-Have Skills:
- Strong understanding of clickstream data and data pipeline architecture
- Hands-on experience with cloud platforms (GCP)
- Expertise in SQL, Python, and Airflow
- Solid software engineering foundation — API design, testing, version control, and deployment practices
- Proven ability to perform exploratory data analysis and data validation
- Knowledge of cloud security, IAM, and networking best practices
- Working knowledge of building or integrating AI/LLM-based components into existing systems
- Excellent problem-solving, stakeholder management, and communication skills
Good-to-Have Skills:
- Certifications such as: Google Cloud Professional Data Engineer / Cloud Architect
- AWS Certified Data Analytics or Azure Data Engineer Associate
- Google Analytics 4 (GAIQ)
- Experience in marketing attribution, commerce data, or analytics ecosystems
- Exposure to cost optimization and cloud resource management
- Experience with agent frameworks (LangChain, ADK, MCP) or LLM APIs
- Experience building automation frameworks or internal data tools
6. Not-a-Fit Criteria
- Individual Contributor Focus: Operates as the team's best individual contributor instead of building team capability or empowering L3s.
- Information Hoarding: Keeps architectural patterns or tribal knowledge trapped in their head rather than creating reusable playbooks and documentation.
- Avoidance of Conflict: Avoids difficult performance conversations with underperforming team members, allowing capability gaps to persist.
- Activity Over Outcomes: Measures success by "tasks completed" rather than pipeline stability, data accuracy, or business impact.
- Functional Siloing: Fails to build partnerships with Marketing or Product teams, leading to misaligned data delivery.
Our Culture & Perks - Where Passion Meets Purpose:
- Competitive CTC: Based on experience and skillset
- Medical Insurance for you and your family
- Return-to-Work Program for New Moms — because career breaks shouldn’t break momentum
- 1 Work From Home Day/Month — flexibility when life calls
- 2 Birthday Leaves/Year — one for you, one for someone you love
- Monthly Engagement Activities — from game nights to learning sessions
- Inclusive Culture & Equal Opportunity Employer — diversity drives our innovation
- We Think Like Engineers & Athletes: we build, we iterate, we scale, we win — together
- 5-day workweek — because balance drives brilliance






