Staff Engineer - Cloud

We seek a skilled and motivated Azure DevOps engineer to join our dynamic team. The ideal candidate will design, implement, and manage CI/CD pipelines, automate deployments, and optimize cloud infrastructure using Azure DevOps tools and services. You will collaborate closely with development and IT teams to ensure seamless integration and delivery of software solutions in a fast-paced environment.

Responsibilities:

• Design, implement, and manage CI/CD pipelines using Azure DevOps.
• Automate infrastructure provisioning and deployments using Infrastructure as Code (IaC) tools like Terraform, ARM templates, or Azure CLI.
• Monitor and optimize Azure environments to ensure high availability, performance, and security.
• Collaborate with development, QA, and IT teams to streamline the software development lifecycle (SDLC).
• Troubleshoot and resolve issues related to build, deployment, and infrastructure.
• Implement and manage version control systems, primarily using Git.
• Manage containerization and orchestration using tools like Docker and Kubernetes.
• Ensure compliance with industry standards and best practices for security, scalability, and reliability.

Role: Full-Time, Long-Term Required: Docker, GCP, CI/CD Preferred: Experience with ML pipelines

OVERVIEW

We are seeking a DevOps engineer to join as a core member of our technical team. This is a long-term position for someone who wants to own infrastructure and deployment for a production machine learning system. You will ensure our prediction pipeline runs reliably, deploys smoothly, and scales as needed.

The ideal candidate thinks about failure modes obsessively, automates everything possible, and builds systems that run without constant attention.

CORE TECHNICAL REQUIREMENTS

Docker (Required): Deep experience with containerization. Efficient Dockerfiles, layer caching, multi-stage builds, debugging container issues. Experience with Docker Compose for local development.

Google Cloud Platform (Required): Strong GCP experience: Cloud Run for serverless containers, Compute Engine for VMs, Artifact Registry for images, Cloud Storage, IAM. You can navigate the console but prefer scripting everything.

CI/CD (Required): Build and maintain deployment pipelines. GitHub Actions required. You automate testing, building, pushing, and deploying. You understand the difference between continuous integration and continuous deployment.

Linux Administration (Required): Comfortable on the command line. SSH, diagnose problems, manage services, read logs, fix things. Bash scripting is second nature.

PostgreSQL (Required): Database administration basics—backups, monitoring, connection management, basic performance tuning. Not a DBA, but comfortable keeping a production database healthy.

Infrastructure as Code (Preferred): Terraform, Pulumi, or similar. Infrastructure should be versioned, reviewed, and reproducible—not clicked together in a console.

WHAT YOU WILL OWN

Deployment Pipeline: Maintaining and improving deployment scripts and CI/CD workflows. Code moves from commit to production reliably with appropriate testing gates.

Cloud Run Services: Managing deployments for model fitting, data cleansing, and signal discovery services. Monitor health, optimize cold starts, handle scaling.

VM Infrastructure: PostgreSQL and Streamlit on GCP VMs. Instance management, updates, backups, security.

Container Registry: Managing images in GitHub Container Registry and Google Artifact Registry. Cleanup policies, versioning, access control.

Monitoring and Alerting: Building observability. Logging, metrics, health checks, alerting. Know when things break before users tell us.

Environment Management: Configuration across local and production. Secrets management. Environment parity where it matters.

WHAT SUCCESS LOOKS LIKE

Deployments are boring—no drama, no surprises. Systems recover automatically from transient failures. Engineers deploy with confidence. Infrastructure changes are versioned and reproducible. Costs are reasonable and resources scale appropriately.

ENGINEERING STANDARDS

Automation First: If you do something twice, automate it. Manual processes are bugs waiting to happen.

Documentation: Runbooks, architecture diagrams, deployment guides. The next person can understand and operate the system.

Security Mindset: Secrets never in code. Least-privilege access. You think about attack surfaces.

Reliability Focus: Design for failure. Backups are tested. Recovery procedures exist and work.

CURRENT ENVIRONMENT

GCP (Cloud Run, Compute Engine, Artifact Registry, Cloud Storage), Docker, Docker Compose, GitHub Actions, PostgreSQL 16, Bash deployment scripts with Python wrapper.

WHAT WE ARE LOOKING FOR

Ownership Mentality: You see a problem, you fix it. You do not wait for assignment.

Calm Under Pressure: When production breaks, you diagnose methodically.

Communication: You explain infrastructure decisions to non-infrastructure people. You document what you build.

Long-Term Thinking: You build systems maintained for years, not quick fixes creating tech debt.

EDUCATION

University degree in Computer Science, Engineering, or related field preferred. Equivalent demonstrated expertise also considered.

TO APPLY

Include: (1) CV/resume, (2) Brief description of infrastructure you built or maintained, (3) Links to relevant work if available, (4) Availability and timezone.

(Candidates from Service based Companies apply-Looking for automation(shell or python scripting))

SHIFT- Shift time either US East coast or west coast (2:30 PM to 10:30 PM India time or 5 to 2 am india time)

Exp- 5 to 8 years

Salary- Upto 25 LPA

Hyderabad based candidates preferred!

Immediate joiners would be preferred!!

Role Objective:

• Ability to identify processes where efficiency could be improved via automation
• Ability to research, prototype, iterate and test automation solutions
• Good Technical understanding of Cloud service offering, with a sound appreciation of the associated business processes.
• Ability to build & maintain a strong working relationship with other Technical teams using the agile methodology (internal and external), Infrastructure Partners and Service Engagement Managers.
• Ability to shape and co-ordinate delivery of key initiatives to deliver improvements in stability
• Good understanding of the cost of the e2e service provision, and delivery of associated savings.
• Knowledge of web security principals
• Strong Linux experience – comfortable working from command line
• Some networking knowledge (routing, DNS)
• Knowledge of HA and DR concepts and experience implementing them
• Working with team to analyse and design infrastructure with 99.99% up-time.

Qualifications:

• Infrastructure automation through DevOps scripting (Eg Python, Ruby, PowerShell, Java, shell) or previous software development experience
• Experience in building and managing production cloud environments from the ground up.
• Hands-on, working experience with primary AWS services (EC2, VPC, RDS, Route53, S3)
• Knowledge on repository management (GitHub, SVN)
• Solid understanding of web application architecture and RDBMS (SQL Server preferred).
• Experience with IT compliance and risk management requirements is a bonus. (Eg Security, Privacy, HIPAA, SOX, etc)
• Strong logical, analytical and problem-solving skills with excellent communication skills.
• Should have degree in computer science, MIS, engineering or equivalent with 5+ years of experience.
• Should be willing to work in rotational shifts (including the nights)

Perks and benefits:

• Health & Wellness
• Paid time off
• Learning at work
• Fun at work
• Night shift allowance
• Comp off
• Pick and drop facility available to certain distance

• At least 5 year of experience in Cloud technologies-AWS and Azure and developing. 
• Experience in implementing DevOps practices and DevOps-tools in areas like CI/CD using Jenkins environment automation, and release automation, virtualization, infra as a code or metrics tracking.
• Hands on experience in DevOps tools configuration in different environments.
• Strong knowledge of working with DevOps design patterns, processes and best practices
• Hand-on experience in Setting up Build pipelines.
• Prior working experience in system administration or architecture in Windows or Linux.
• Must have experience in GIT (BitBucket, GitHub, GitLab)
• Hands-on experience on Jenkins pipeline scripting.
• Hands-on knowledge in one scripting language (Nant, Perl, Python, Shell or PowerShell)
• Configuration level skills in tools like SonarQube (or similar tools) and Artifactory.
• Expertise on Virtual Infrastructure (VMWare or VirtualBox or QEMU or KVM or Vagrant) and environment automation/provisioning using SaltStack/Ansible/Puppet/Chef
• Deploying, automating, maintaining and managing Azure cloud based production systems including monitoring capacity.
• Good to have experience in migrating code repositories from one source control to another.
• Hands-on experience in Docker container and orchestration based deployments like Kubernetes, Service Fabric, Docker swarm.
• Must have good communication skills and problem solving skills

Skills Required:

- Good experience with programming language Python
- Strong experience in Docker.
- Good knowledge with any of the Cloud Platform like Azure.
- Must be comfortable working in a Linux environment.
- Must have exposure into IOT domain and its protocols ((Zigbee & BLE ,LoRa,Modbus)
- Must be a good team player.
- Strong Communication Skills

Responsibilities

• Implement various development, testing, automation tools, and IT infrastructure
• Design, build and automate the AWS infrastructure (VPC, EC2, Networking, EMR, RDS, S3, ALB, Cloud Front, etc.) using Terraform
• Manage end-to-end production workloads hosted on Docker and AWS
• Automate CI pipeline using Groovy DSL
• Deploy and configure Kubernetes clusters (EKS)
• Design and build a CI/CD Pipeline to deploy applications using Jenkins and Docker

Eligibility

• At least 8 years of proven experience in AWS-based DevOps/cloud engineering and implementations
• Expertise in all common AWS Cloud services like EC2, EKS, S3, VPC, Lambda, API Gateway, ALB, Redis, etc.
• Experience in deploying and managing production environments in Amazon AWS
• Strong experience in continuous integration and continuous deployment
• Knowledge of application build, deployment, and configuration using one of the tools: Jenkins

About Us -Celebal Technologies is a premier software services company in the field of Data Science, Big Data and Enterprise Cloud. Celebal Technologies helps you to discover the competitive advantage by employing intelligent data solutions using cutting-edge technology solutions that can bring massive value to your organization. The core offerings are around "Data to Intelligence", wherein we leverage data to extract intelligence and patterns thereby facilitating smarter and quicker decision making for clients. With Celebal Technologies, who understands the core value of modern analytics over the enterprise, we help the business in improving business intelligence and more data-driven in architecting solutions.

Key Responsibilities

•        As a part of the DevOps team, you will be responsible for configuration, optimization, documentation, and support of the CI/CD components.

•        Creating and managing build and release pipelines with Azure DevOps and Jenkins.

•        Assist in planning and reviewing application architecture and design to promote an efficient deployment process.

•        Troubleshoot server performance issues & handle the continuous integration system.

•        Automate infrastructure provisioning using ARM Templates and Terraform.

•        Monitor and Support deployment, Cloud-based and On-premises Infrastructure.

•        Diagnose and develop root cause solutions for failures and performance issues in the production environment.

•        Deploy and manage Infrastructure for production applications

•        Configure security best practices for application and infrastructure

Essential Requirements

•        Good hands-on experience with cloud platforms like Azure, AWS & GCP. (Preferably Azure)

•        Strong knowledge of CI/CD principles.

•        Strong work experience with CI/CD implementation tools like Azure DevOps, Team city, Octopus Deploy, AWS Code Deploy, and Jenkins.

•        Experience of writing automation scripts with PowerShell, Bash, Python, etc.

•        GitHub, JIRA, Confluence, and Continuous Integration (CI) system.

•        Understanding of secure DevOps practices

Good to Have -

•        Knowledge of scripting languages such as PowerShell, Bash

•        Experience with project management and workflow tools such as Agile, Jira, Scrum/Kanban, etc.

•        Experience with Build technologies and cloud services. (Jenkins, TeamCity, Azure DevOps, Bamboo, AWS Code Deploy)

•        Strong communication skills and ability to explain protocol and processes with team and management.

•        Must be able to handle multiple tasks and adapt to a constantly changing environment.

•        Must have a good understanding of SDLC.

•        Knowledge of Linux, Windows server, Monitoring tools, and Shell scripting.

•        Self-motivated; demonstrating the ability to achieve in technologies with minimal supervision.

•        Organized, flexible, and analytical ability to solve problems creatively.