11+ Apache Beam Jobs in Chennai | Apache Beam Job openings in Chennai

Data Engineer- Senior

Cubera is a data company revolutionizing big data analytics and Adtech through data share value principles wherein the users entrust their data to us. We refine the art of understanding, processing, extracting, and evaluating the data that is entrusted to us. We are a gateway for brands to increase their lead efficiency as the world moves towards web3.

What are you going to do?

Design & Develop high performance and scalable solutions that meet the needs of our customers.

Closely work with the Product Management, Architects and cross functional teams.

Build and deploy large-scale systems in Java/Python.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Create data tools for analytics and data scientist team members that assist them in building and optimizing their algorithms.

Follow best practices that can be adopted in Bigdata stack.

Use your engineering experience and technical skills to drive the features and mentor the engineers.

What are we looking for ( Competencies) :

Bachelor’s degree in computer science, computer engineering, or related technical discipline.

Overall 5 to 8 years of programming experience in Java, Python including object-oriented design.

Data handling frameworks: Should have a working knowledge of one or more data handling frameworks like- Hive, Spark, Storm, Flink, Beam, Airflow, Nifi etc.

Data Infrastructure: Should have experience in building, deploying and maintaining applications on popular cloud infrastructure like AWS, GCP etc.

Data Store: Must have expertise in one of general-purpose No-SQL data stores like Elasticsearch, MongoDB, Redis, RedShift, etc.

Strong sense of ownership, focus on quality, responsiveness, efficiency, and innovation.

Ability to work with distributed teams in a collaborative and productive manner.

Benefits:

Competitive Salary Packages and benefits.

Collaborative, lively and an upbeat work environment with young professionals.

Job Category: Development

Job Type: Full Time

Job Location: Bangalore

AI & ML (45 Days – Live Hands‑On)

Program Fee: ₹25,000

Duration: 45 Days

Mode: Hybrid (Online Sessions + Live Lab Access)

Eligibility: Freshers, Final‑Year Students, and Career Switchers

About the Internship

This intensive 45‑day internship program is designed for freshers who want to build strong, industry‑relevant skills in Cloud Infrastructure, Cybersecurity, and AI/ML model development. The program offers live production hands‑on training, allowing interns to work on real-world architectures, security workflows, and AI/ML deployments.

Participants will receive end‑to‑end exposure to modern cloud platforms, DevOps practices, security operations, and machine learning deployment, making them job‑ready for roles like:

• Cloud/Infra Engineer
• DevOps Engineer
• Security Analyst
• AI/ML Engineer
• Site Reliability Engineer (SRE)

Key Highlights

• 45 days of practical, mentor-led training
• Live production-style projects and deployments
• Hands‑on experience with:
• AWS / Azure Cloud
• Terraform, CI/CD, Docker, Kubernetes
• Security Hardening & IAM
• Python ML pipelines & model deployment
• Architect & deploy real systems using best practices
• Build portfolio-ready projects
• Receive an industry-recognized Internship Certificate

What You Will Learn

1️⃣ Cloud Infrastructure & DevOps

• Cloud fundamentals (AWS/Azure/GCP)
• Linux administration & scripting
• VPC, Subnets, Routing, NAT, Firewalls
• EC2 provisioning & autoscaling
• Load balancing & High Availability
• Terraform for Infrastructure as Code
• CI/CD pipelines using Jenkins / GitHub Actions
• Docker containerization & Kubernetes basics

2️⃣ Cybersecurity & Cloud Security

• IAM roles, policies, access control
• Server security & hardening
• SSL/TLS, encryption, key management
• Secure VPC & subnet design
• Threat detection & logging
• Secrets management
• Network segmentation & firewall best practices

3️⃣ AI & Machine Learning

• Python for ML
• Supervised and unsupervised algorithms
• Data preprocessing & model training
• Model evaluation & optimization
• Build ML inference APIs using FastAPI/Flask
• Containerize and deploy ML models to cloud
• Integrate monitoring for ML workflows

✅ Live Hands‑On Projects

Interns will work on real-world, production-grade projects such as:

• Deploy a secure 3‑tier web application on cloud
• Automate infra provisioning using Terraform
• Build CI/CD pipelines for automated deployments
• Harden servers & configure security groups, IAM
• Develop and deploy an ML model as a cloud API
• Create monitoring dashboards with Prometheus/Grafana
• End-to-end system deployment with logging and alerting

Each intern will complete a Capstone Project and present it during the final evaluation.

✅ Internship Deliverables

1. Internship Completion Certificate
2. 3+ Production‑level projects
3. GitHub portfolio with all code and deployments
4. Cloud & ML documentation
5. Resume enhancement and guidance
6. Career mentoring + interview preparation

✅ Who Should Apply

This internship is ideal for:

• Fresh graduates
• Final‑year engineering or IT students
• BSc, BCA, MCA, B.Tech learners
• Professionals switching careers to Cloud/DevOps/AI
• Anyone seeking hands‑on, real‑time industry experience

✅ Program Fee

₹25,000/- (includes training, labs, live‑project access, certificate, and mentorship)

✅ Certificate Provided

All participants will receive a verified Internship Certificate, including:

• Candidate Name
• Internship Duration & Dates
• Skills Covered
• Project Evaluation Score
• Authorized Signatory & Company Seal

Job Position: Lead II - Software Engineering

Domain: Information technology (IT)

Location: India - Thiruvananthapuram

Salary: Best in Industry

Job Positions: 1

Experience: 8 - 12 Years

Skills: .Net, Sql Azure, Rest Api, Vue.Js

Notice Period: Immediate – 30 Days

Job Summary:

We are looking for a highly skilled Senior .NET Developer with a minimum of 7 years of experience across the full software development lifecycle, including post-live support. The ideal candidate will have a strong background in .NET backend API development, Agile methodologies, and Cloud infrastructure (preferably Azure). You will play a key role in solution design, development, DevOps pipeline enhancement, and mentoring junior engineers.

Key Responsibilities:

• Design, develop, and maintain scalable and secure .NET backend APIs.
• Collaborate with product owners and stakeholders to understand requirements and translate them into technical solutions.
• Lead and contribute to Agile software delivery processes (Scrum, Kanban).
• Develop and improve CI/CD pipelines and support release cadence targets, using Infrastructure as Code tools (e.g., Terraform).
• Provide post-live support, troubleshooting, and issue resolution as part of full lifecycle responsibilities.
• Implement unit and integration testing to ensure code quality and system stability.
• Work closely with DevOps and cloud engineering teams to manage deployments on Azure (Web Apps, Container Apps, Functions, SQL).
• Contribute to front-end components when necessary, leveraging HTML, CSS, and JavaScript UI frameworks.
• Mentor and coach engineers within a co-located or distributed team environment.
• Maintain best practices in code versioning, testing, and documentation.

Mandatory Skills:

• 7+ years of .NET development experience, including API design and development
• Strong experience with Azure Cloud services, including:
• Web/Container Apps
• Azure Functions
• Azure SQL Server
• Solid understanding of Agile development methodologies (Scrum/Kanban)
• Experience in CI/CD pipeline design and implementation
• Proficient in Infrastructure as Code (IaC) – preferably Terraform
• Strong knowledge of RESTful services and JSON-based APIs
• Experience with unit and integration testing techniques
• Source control using Git
• Strong understanding of HTML, CSS, and cross-browser compatibility

Good-to-Have Skills:

• Experience with Kubernetes and Docker
• Knowledge of JavaScript UI frameworks, ideally Vue.js
• Familiarity with JIRA and Agile project tracking tools
• Exposure to Database as a Service (DBaaS) and Platform as a Service (PaaS) concepts
• Experience mentoring or coaching junior developers
• Strong problem-solving and communication skills

Profile: AWS Data Engineer

Mode- Hybrid

Experience- 5+7 years

Locations - Bengaluru, Pune, Chennai, Mumbai, Gurugram

Roles and Responsibilities

• Design and maintain ETL pipelines using AWS Glue and Python/PySpark
• Optimize SQL queries for Redshift and Athena
• Develop Lambda functions for serverless data processing
• Configure AWS DMS for database migration and replication
• Implement infrastructure as code with CloudFormation
• Build optimized data models for performance
• Manage RDS databases and AWS service integrations
• Troubleshoot and improve data processing efficiency
• Gather requirements from business stakeholders
• Implement data quality checks and validation
• Document data pipelines and architecture
• Monitor workflows and implement alerting
• Keep current with AWS services and best practices

Required Technical Expertise:

• Python/PySpark for data processing
• AWS Glue for ETL operations
• Redshift and Athena for data querying
• AWS Lambda and serverless architecture
• AWS DMS and RDS management
• CloudFormation for infrastructure
• SQL optimization and performance tuning

Job Title: Site Reliability Engineer (SRE)

Experience: 4+ Years

Work Location: Bangalore / Chennai / Pune / Gurgaon

Work Mode: Hybrid or Onsite (based on project need)

Domain Preference: Candidates with past experience working in shoe/footwear retail brands (e.g., Nike, Adidas, Puma) are highly preferred.

🛠️ Key Responsibilities

• Design, implement, and manage scalable, reliable, and secure infrastructure on AWS.
• Develop and maintain Python-based automation scripts for deployment, monitoring, and alerting.
• Monitor system performance, uptime, and overall health using tools like Prometheus, Grafana, or Datadog.
• Handle incident response, root cause analysis, and ensure proactive remediation of production issues.
• Define and implement Service Level Objectives (SLOs) and Error Budgets in alignment with business requirements.
• Build tools to improve system reliability, automate manual tasks, and enforce infrastructure consistency.
• Collaborate with development and DevOps teams to ensure robust CI/CD pipelines and safe deployments.
• Conduct chaos testing and participate in on-call rotations to maintain 24/7 application availability.

✅ Must-Have Skills

• 4+ years of experience in Site Reliability Engineering or DevOps with a focus on reliability, monitoring, and automation.
• Strong programming skills in Python (mandatory).
• Hands-on experience with AWS cloud services (EC2, S3, Lambda, ECS/EKS, CloudWatch, etc.).
• Expertise in monitoring and alerting tools like Prometheus, Grafana, Datadog, CloudWatch, etc.
• Strong background in Linux-based systems and shell scripting.
• Experience implementing infrastructure as code using tools like Terraform or CloudFormation.
• Deep understanding of incident management, SLOs/SLIs, and postmortem practices.
• Prior working experience in footwear/retail brands such as Nike or similar is highly preferred.

About us:

HappyFox is a software-as-a-service (SaaS) support platform. We offer an enterprise-grade help desk ticketing system and intuitively designed live chat software.

We serve over 12,000 companies in 70+ countries. HappyFox is used by companies that span across education, media, e-commerce, retail, information technology, manufacturing, non-profit, government and many other verticals that have an internal or external support function.

To know more, Visit! - https://www.happyfox.com/

A Senior Automation Test Engineer at HappyFox is an integral part of the QA team responsible to ensure product quality and integrity with a special focus on the development and execution of test automation. 

Responsibilities:

• Owning the quality of any deliverables including new features and enhancements.
• Working closely with the product team in understanding the requirements and user workflow.
• Developing and executing test plans and test cases with a strong emphasis on using code to solve technical challenges and shorten the regression test cycle through automation.
• Performing automated API testing.
• Contributing to building of a Continuous Integration (CI) environment and ongoing process improvement activities.
• Identifying required improvements in the test and development processes; making contributions to our automation tools that address specific needs.
• Raising defects/bugs and tracking them till closure.

Requirements:

• Minimum 5 years of relevant experience in QA with at least 3 years of experience in automation.
• Expertise in Selenium tool for automation testing.
• Good understanding of the Agile software development methodology (Kanban or Scrum) and QA's role in it.
• Good knowledge of object-oriented programming, along with requisite coding and debugging skills.
• Design and development skills in Python and/or Java.
• Some knowledge of continuous integration practices.
• Excellent verbal and written communication skills.
• Experience working in SaaS based product company (optional)
• Knowledge of Performance / Load testing tool (optional)
• Experience working for a bootstrapped high-growth startup (optional)

* Experience in C/C++ and have strong experience embedded application development and integration in Linux

* Good in creating unit tests, performing code reviews, optimizing performance and ensuring standards for maintainability  

* Debugging, profiling, and performance optimization skills

Responsibilities

• Designing and implementing new features and functionality
• Establishing and guiding the website’s architecture
• Ensuring high-performance and availability, and managing all technical aspects of the CMS
• Helping formulate an effective, responsive design and turning it into a working theme and plugin.

Skills and Qualifications

• Good understanding of front-end technologies, including HTML5, CSS3, JavaScript, jQuery
• Experience building user interfaces for websites and/or web applications
• Experience designing and developing responsive design websites
• Comfortable working with debugging tools like Firebug, Chrome inspector, etc.
• Ability to understand CSS changes and their ramifications to ensure consistent style across platforms and browsers
• Ability to convert comprehensive layout and wireframes into working HTML pages
• Knowledge of how to interact with RESTful APIs and formats (JSON, XML)
• Strong understanding of PHP back-end development