Cloudforms performance ENgineer

Job Summary

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities

1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.

2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.

3. Design and develop etl processes, data models, and data integration solutions.

4. Provide technical guidance and mentorship to the team members.

5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.

6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.

7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.

Skill Requirements

1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.

2. Strong experience with sql and oracle pl/sql for data querying and manipulation.

3. Advanced programming skills in python for scripting and data processing tasks.

4. Knowledge of data modeling, data warehousing concepts, and database design principles.

5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.

6. Strong analytical and problem-solving skills with attention to detail.

7. Experience in data visualization tools and techniques is a plus.

Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.

Skill (Primary)

Data Fabric-Azure-Azure Data Factory (ADF)

Required Skills: Advanced AWS Infrastructure Expertise, CI/CD Pipeline Automation, Monitoring, Observability & Incident Management, Security, Networking & Risk Management, Infrastructure as Code & Scripting

Criteria:

• 5+ years of DevOps/SRE experience in cloud-native, product-based companies (B2C scale preferred)
• Strong hands-on AWS expertise across core and advanced services (EC2, ECS/EKS, Lambda, S3, CloudFront, RDS, VPC, IAM, ELB/ALB, Route53)
• Proven experience designing high-availability, fault-tolerant cloud architectures for large-scale traffic
• Strong experience building & maintaining CI/CD pipelines (Jenkins mandatory; GitHub Actions/GitLab CI a plus)
• Prior experience running production-grade microservices deployments and automated rollout strategies (Blue/Green, Canary)
• Hands-on experience with monitoring & observability tools (Grafana, Prometheus, ELK, CloudWatch, New Relic, etc.)
• Solid hands-on experience with MongoDB in production, including performance tuning, indexing & replication
• Strong scripting skills (Bash, Shell, Python) for automation
• Hands-on experience with IaC (Terraform, CloudFormation, or Ansible)
• Deep understanding of networking fundamentals (VPC, subnets, routing, NAT, security groups)
• Strong experience in incident management, root cause analysis & production firefighting

Description

Role Overview

Company is seeking an experienced Senior DevOps Engineer to design, build, and optimize cloud infrastructure on AWS, automate CI/CD pipelines, implement monitoring and security frameworks, and proactively identify scalability challenges. This role requires someone who has hands-on experience running infrastructure at B2C product scale, ideally in media/OTT or high-traffic applications.

 Key Responsibilities

1. Cloud Infrastructure — AWS (Primary Focus)

• Architect, deploy, and manage scalable infrastructure using AWS services such as EC2, ECS/EKS, Lambda, S3, CloudFront, RDS, ELB/ALB, VPC, IAM, Route53, etc.
• Optimize cloud cost, resource utilization, and performance across environments.
• Design high-availability, fault-tolerant systems for streaming workloads.

2. CI/CD Automation

• Build and maintain CI/CD pipelines using Jenkins, GitHub Actions, or GitLab CI.
• Automate deployments for microservices, mobile apps, and backend APIs.
• Implement blue/green and canary deployments for seamless production rollouts.

3. Observability & Monitoring

• Implement logging, metrics, and alerting using tools like Grafana, Prometheus, ELK, CloudWatch, New Relic, etc.
• Perform proactive performance analysis to minimize downtime and bottlenecks.
• Set up dashboards for real-time visibility into system health and user traffic spikes.

4. Security, Compliance & Risk Highlighting

• Conduct frequent risk assessments and identify vulnerabilities in:

  o Cloud architecture

  o Access policies (IAM)

  o Secrets & key management

  o Data flows & network exposure

• Implement security best practices including VPC isolation, WAF rules, firewall policies, and SSL/TLS management.

5. Scalability & Reliability Engineering

• Analyze traffic patterns for OTT-specific load variations (weekends, new releases, peak hours).
• Identify scalability gaps and propose solutions across:
•   o Microservices
•   o Caching layers
•   o CDN distribution (CloudFront)
•   o Database workloads
• Perform capacity planning and load testing to ensure readiness for 10x traffic growth.

6. Database & Storage Support

• Administer and optimize MongoDB for high-read/low-latency use cases.
• Design backup, recovery, and data replication strategies.
• Work closely with backend teams to tune query performance and indexing.

7. Automation & Infrastructure as Code

• Implement IaC using Terraform, CloudFormation, or Ansible.
• Automate repetitive infrastructure tasks to ensure consistency across environments.

Required Skills & Experience

Technical Must-Haves

• 5+ years of DevOps/SRE experience in cloud-native, product-based companies.
• Strong hands-on experience with AWS (core and advanced services).
• Expertise in Jenkins CI/CD pipelines.
• Solid background working with MongoDB in production environments.
• Good understanding of networking: VPCs, subnets, security groups, NAT, routing.
• Strong scripting experience (Bash, Python, Shell).
• Experience handling risk identification, root cause analysis, and incident management.

Nice to Have

• Experience with OTT, video streaming, media, or any content-heavy product environments.
• Familiarity with containers (Docker), orchestration (Kubernetes/EKS), and service mesh.
• Understanding of CDN, caching, and streaming pipelines.

Personality & Mindset

• Strong sense of ownership and urgency—DevOps is mission critical at OTT scale.
• Proactive problem solver with ability to think about long-term scalability.
• Comfortable working with cross-functional engineering teams.

Why Join company?

• Build and operate infrastructure powering millions of monthly users.

• Opportunity to shape DevOps culture and cloud architecture from the ground up.

• High-impact role in a fast-scaling Indian OTT product.

Job Purpose and Impact

The DevOps Engineer is a key position to strengthen the security automation capabilities which have been identified as a critical area for growth and specialization within Global IT’s scope. As part of the Cyber Intelligence Operation’s DevOps Team, you will be helping shape our automation efforts by building, maintaining and supporting our security infrastructure.

Key Accountabilities

• Collaborate with internal and external partners to understand and evaluate business requirements.
• Implement modern engineering practices to ensure product quality.
• Provide designs, prototypes and implementations incorporating software engineering best practices, tools and monitoring according to industry standards.
• Write well-designed, testable and efficient code using full-stack engineering capability.
• Integrate software components into a fully functional software system.
• Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
• Proficiency in at least one configuration management or orchestration tool, such as Ansible.
• Experience with cloud monitoring and logging services.

Qualifications

Minimum Qualifications

• Bachelor's degree in a related field or equivalent exp
• Knowledge of public cloud services & application programming interfaces
• Working exp with continuous integration and delivery practices

Preferred Qualifications

• 3-5 years of relevant exp whether in IT, IS, or software development
• Exp in:
•  Code repositories such as Git
• Scripting languages (Python & PowerShell)
• Using Windows, Linux, Unix, and mobile platforms within cloud services such as AWS
• Cloud infrastructure as a service (IaaS) / platform as a service (PaaS), microservices, Docker containers, Kubernetes, Terraform, Jenkins
• Databases such as Postgres, SQL, Elastic

• Candidate should have good Platform experience on Azure with Terraform.
• The devops engineer  needs to help developers, create the Pipelines and K8s Deployment Manifests.
• Good to have experience on migrating data from (AWS) to Azure. 
• To manage/automate infrastructure automatically using Terraforms. Jenkins is the key CI/CD tool which we uses and it will be used to run these Terraforms.
• VMs to be provisioned on Azure Cloud and managed.
• Good hands on experience of Networking on Cloud is required.
• Ability to setup Database on VM as well as managed DB and Proper set up of cloud hosted microservices needs to be done to communicate with the db services.
• Kubernetes, Storage, KeyValult, Networking(load balancing and routing) and VMs are the key infrastructure expertise which are essential. 
• Requirement is  to administer Kubernetes cluster end to end. (Application deployment, managing namespaces, load balancing, policy setup, using blue-green/canary deployment models etc).
• The experience in AWS is desirable 
• Python experience is optional however Power shell is mandatory
• Know-how on the use of GitHub

• Cloud and virtualization-based technologies (Amazon Web Services (AWS), VMWare).
• Java Application Server Administration (Weblogic, WidlFfy, JBoss, Tomcat).
• Docker and Kubernetes (EKS)
• Linux/UNIX Administration (Amazon Linux and RedHat).
• Developing and supporting cloud infrastructure designs and implementations and guiding application development teams.
• Configuration Management tools (Chef or Puppet or ansible).
• Log aggregations tools such as Elastic and/or Splunk.
• Automate infrastructure and application deployment-related tasks using terraform.
• Automate repetitive tasks required to maintain a secure and up-to-date operational environment.

Responsibilities

• Build and support always-available private/public cloud-based software-as-a-service (SaaS) applications.
• Build AWS or other public cloud infrastructure using Terraform.
• Deploy and manage Kubernetes (EKS) based docker applications in AWS.
• Create custom OS images using Packer.
• Create and revise infrastructure and architectural designs and implementation plans and guide the implementation with operations.
• Liaison between application development, infrastructure support, and tools (IT Services) teams.
• Development and documentation of Chef recipes and/or ansible scripts. Support throughout the entire deployment lifecycle (development, quality assurance, and production).
• Help developers leverage infrastructure, application, and cloud platform features and functionality participate in code and design reviews, and support developers by building CI/CD pipelines using Bamboo, Jenkins, or Spinnaker.
• Create knowledge-sharing presentations and documentation to help developers and operations teams understand and leverage the system's capabilities.
• Learn on the job and explore new technologies with little supervision.
• Leverage scripting (BASH, Perl, Ruby, Python) to build required automation and tools on an ad-hoc basis.

Who we have in mind:

• Solid experience in building a solution on AWS or other public cloud services using Terraform.
• Excellent problem-solving skills with a desire to take on responsibility.
• Extensive knowledge in containerized application and deployment in Kubernetes
• Extensive knowledge of the Linux operating system, RHEL preferred.
• Proficiency with shell scripting.
• Experience with Java application servers.
• Experience with GiT and Subversion.
• Excellent written and verbal communication skills with the ability to communicate technical issues to non-technical and technical audiences.
• Experience working in a large-scale operational environment.
• Internet and operating system security fundamentals.
• Extensive knowledge of massively scalable systems. Linux operating system/application development desirable.
• Programming in scripting languages such as Python. Other object-oriented languages (C++, Java) are a plus.
• Experience with Configuration Management Automation tools (chef or puppet).
• Experience with virtualization, preferably on multiple hypervisors.
• BS/MS in Computer Science or equivalent experience.
• Excellent written and verbal skills.

Education or Equivalent Experience:

• Bachelor's degree or equivalent education in related fields
• Certificates of training in associated fields/equipment’s

Responsibilities

- Building and maintenance of resilient and scalable production infrastructure 

- Improvement of monitoring systems

- Creation and support of development automation processes (CI / CD)

- Participation in infrastructure development 

- Detection of problems in architecture and proposing of solutions for solving them 

- Creation of tasks for system improvements for system scalability, performance and monitoring

- Analysis of product requirements in the aspect of devops 

- Managing a team of DevOps, control of task deliveries 

- Incident analysis and fixing 

Technology stack

Linux, Bash, Salt/Ansible, LXC, libvirt, IPsec, VXLAN, Open vSwitch, OpenVPN, OSPF, BIRD, Cisco NX-OS, Multicast, PIM, LVM, software RAID, LUKS, PostgreSQL, nginx, haproxy, Prometheus, Grafana, Zabbix, GitLab, Capistrano

Skills and Experience

- Understanding of the distributed systems principles 

- Understanding of principles for building a resistant network infrastructure 

- Experience of Ubuntu Linux administration (Debian-like will be a plus)

- Strong knowledge of Bash

- Experience of working with LXC-containers 

- Understanding and experience with infrastructure as a code approach 

- Experience of development idempotent Ansible roles

- Experience with relational databases (PostgeSQL), ability to create simple SQL queries 

- Experience with git

- Experience with monitoring and metric collect systems (Prometheus, Grafana, Zabbix)

- Understanding of dynamic routing (OSPF)  

Preferred experience

- Experience of working with highload zero-downtown environments 

- Experience of coding on Python

- Experience of working with IPsec, VXLAN, Open vSwitch

- Knowledge and experience of working with network equipment Cisco

- Experience of working with Cisco NX-OS

- Knowledge of principles of multicast protocols IGMP, PIM

- Experience of setting multicast on Cisco equipment

- Experience of working with Solarflare Onload

- Experience administering Atlassian products