Devops Engineer

Role: Full-Time, Long-Term Required: Docker, GCP, CI/CD Preferred: Experience with ML pipelines

OVERVIEW

We are seeking a DevOps engineer to join as a core member of our technical team. This is a long-term position for someone who wants to own infrastructure and deployment for a production machine learning system. You will ensure our prediction pipeline runs reliably, deploys smoothly, and scales as needed.

The ideal candidate thinks about failure modes obsessively, automates everything possible, and builds systems that run without constant attention.

CORE TECHNICAL REQUIREMENTS

Docker (Required): Deep experience with containerization. Efficient Dockerfiles, layer caching, multi-stage builds, debugging container issues. Experience with Docker Compose for local development.

Google Cloud Platform (Required): Strong GCP experience: Cloud Run for serverless containers, Compute Engine for VMs, Artifact Registry for images, Cloud Storage, IAM. You can navigate the console but prefer scripting everything.

CI/CD (Required): Build and maintain deployment pipelines. GitHub Actions required. You automate testing, building, pushing, and deploying. You understand the difference between continuous integration and continuous deployment.

Linux Administration (Required): Comfortable on the command line. SSH, diagnose problems, manage services, read logs, fix things. Bash scripting is second nature.

PostgreSQL (Required): Database administration basics—backups, monitoring, connection management, basic performance tuning. Not a DBA, but comfortable keeping a production database healthy.

Infrastructure as Code (Preferred): Terraform, Pulumi, or similar. Infrastructure should be versioned, reviewed, and reproducible—not clicked together in a console.

WHAT YOU WILL OWN

Deployment Pipeline: Maintaining and improving deployment scripts and CI/CD workflows. Code moves from commit to production reliably with appropriate testing gates.

Cloud Run Services: Managing deployments for model fitting, data cleansing, and signal discovery services. Monitor health, optimize cold starts, handle scaling.

VM Infrastructure: PostgreSQL and Streamlit on GCP VMs. Instance management, updates, backups, security.

Container Registry: Managing images in GitHub Container Registry and Google Artifact Registry. Cleanup policies, versioning, access control.

Monitoring and Alerting: Building observability. Logging, metrics, health checks, alerting. Know when things break before users tell us.

Environment Management: Configuration across local and production. Secrets management. Environment parity where it matters.

WHAT SUCCESS LOOKS LIKE

Deployments are boring—no drama, no surprises. Systems recover automatically from transient failures. Engineers deploy with confidence. Infrastructure changes are versioned and reproducible. Costs are reasonable and resources scale appropriately.

ENGINEERING STANDARDS

Automation First: If you do something twice, automate it. Manual processes are bugs waiting to happen.

Documentation: Runbooks, architecture diagrams, deployment guides. The next person can understand and operate the system.

Security Mindset: Secrets never in code. Least-privilege access. You think about attack surfaces.

Reliability Focus: Design for failure. Backups are tested. Recovery procedures exist and work.

CURRENT ENVIRONMENT

GCP (Cloud Run, Compute Engine, Artifact Registry, Cloud Storage), Docker, Docker Compose, GitHub Actions, PostgreSQL 16, Bash deployment scripts with Python wrapper.

WHAT WE ARE LOOKING FOR

Ownership Mentality: You see a problem, you fix it. You do not wait for assignment.

Calm Under Pressure: When production breaks, you diagnose methodically.

Communication: You explain infrastructure decisions to non-infrastructure people. You document what you build.

Long-Term Thinking: You build systems maintained for years, not quick fixes creating tech debt.

EDUCATION

University degree in Computer Science, Engineering, or related field preferred. Equivalent demonstrated expertise also considered.

TO APPLY

Include: (1) CV/resume, (2) Brief description of infrastructure you built or maintained, (3) Links to relevant work if available, (4) Availability and timezone.

DevOps Lead Engineer

We are seeking a skilled DevOps Lead Engineer with 8 to 10 yrs. of experience who handles the entire DevOps lifecycle and is accountable for the implementation of the process. A DevOps Lead Engineer is liable for automating all the manual tasks for developing and deploying code and data to implement continuous deployment and continuous integration frameworks. They are also held responsible for maintaining high availability of production and non-production work environments.

Essential Requirements (must have):

• Bachelor's degree preferable in Engineering.

• Solid 5+ experience with AWS, DevOps, and related technologies

Skills Required:

Cloud Performance Engineering

• Performance scaling in a Micro-Services environment

• Horizontal scaling architecture

• Containerization (such as Dockers) & Deployment

• Container Orchestration (such as Kubernetes) & Scaling

DevOps Automation

• End to end release automation.

• Solid Experience in DevOps tools like GIT, Jenkins, Docker, Kubernetes, Terraform, Ansible, CFN etc.

• Solid experience in Infra Automation (Infrastructure as Code), Deployment, and Implementation.

• Candidates must possess experience in using Linux, Jenkins, and ample experience in Configuring and automating the monitoring tools.

• Strong scripting knowledge

• Strong analytical and problem-solving skills.

• Cloud and On-prem deployments

Infrastructure Design & Provisioning

• Infra provisioning.

• Infrastructure Sizing

• Infra Cost Optimization

• Infra security

• Infra monitoring & site reliability.

Job Responsibilities:

• Responsible for creating software deployment strategies that are essential for the successful

deployment of software in the work environment and provide stable environment for delivery of

quality.

• The DevOps Lead Engineer is accountable for designing, building, configuring, and optimizing

automation systems that help to execute business web and data infrastructure platforms.

• The DevOps Lead Engineer is involved in creating technology infrastructure, automation tools,

and maintaining configuration management.

• The Lead DevOps Engineer oversees and leads the activities of the DevOps team. They are

accountable for conducting training sessions for the juniors in the team, mentoring, career

support. They are also answerable for the architecture and technical leadership of the complete

DevOps infrastructure.

Job Description :

Acceldata is creating the Data observability space. We make it possible for data-driven enterprises to effectively monitor, discover, and validate Data pipelines at Petabyte scale. Our customers include a Fortune 500 company, one of Asia's largest telecom companies, and a unicorn fintech startup. We are lean, hungry, customer-obsessed, and growing fast. Our Engineering team values productivity, integrity, and pragmatism. We provide a flexible, remote-friendly work environment.

Roles & responsibilities:

• Champion engineering and operational excellence.
• Establish a solid infrastructure framework and excellent development and deployment processes.
• Provide technical guidance to both your team members and your peers from the development team.
• Work with the development teams closely to gather system requirements, new service proposals and large system improvements and come up with the infrastructure architecture leading to stable, well-monitored fly, performant and secure systems.
• Be part of and help create a positive work environment based on accountability.
• Communicate across functions and drive engineering initiatives.
• Initiate cross team collaboration with product development teams to develop high quality, polished products and services.

Must haves:

• 5+ years of professional experience developing, and launching software products on Cloud.
• Basic understanding Java/Go Programming
• Good Understanding of Container Technologies/Orchestration platforms (e. g Docker, Kubernetes)
• Deep understanding of AWS or Any Cloud.
• Good understanding of data stores like Postgres, Redis, Kafka, and Elasticsearch.
• Good Understanding of Operating systems
• Strong technical background with track record of individual technical accomplishments
• Ability to handle multiple competing priorities in a fast paced environment
• Ability to establish credibility with smart engineers quickly.
• Most importantly, ability to learn and urge to learn new things.
• B.Tech/M.Tech in Computer Science or a related technical field.

Good to Have:

• Hands-on knowledge of Configuration Management and Deployment tools like – Ansible, Terraform etc.
• Proficient in scripting, and Git and Git workflows
• Experience in developing Continuous Integration/ Continuous Delivery pipelines
• Knowledge of Big Data systems.

• Essentail Skills:
• Docker
• Jenkins
• Python dependency management using conda and pip

• Base Linux System Commands, Scripting
• Docker Container Build & Testing
• Common knowledge of minimizing container size and layers
• Inspecting containers for un-used / underutilized systems
• Multiple Linux OS support for virtual system

• Has experience as a user of jupyter / jupyter lab to test and fix usability issues in workbenches
• Templating out various configurations for different use cases (we use Python Jinja2 but are open to other languages / libraries)
• Jenkins PIpeline
• Github API Understanding to trigger builds, tags, releases
• Artifactory Experience
• Nice to have: Kubernetes, ArgoCD, other deployment automation tool sets (DevOps)

Job Description:

• Hands on experience with Ansible & Terraform.
• Scripting language, such as Python or Bash or PowerShell is required and willingness to learn and master others. 
• Troubleshooting and resolving automation, build, and CI/CD related issues (in cloud environment like AWS or Azure).
• Experience with Kubernetes is mandate.
• To develop and maintain tooling and environments for test and production environments.
• Assist team members in the development and maintenance of tooling for integration testing, performance testing, security testing, as well as source control systems (that includes working in CI systems like Azure DevOps, Team City, and orchestration tools like Octopus).
• Good with Linux environment.

• Ensure reliable operation of CI/CD pipelines
• Orchestrate the provisioning, load balancing, configuration, monitoring and billing of resources in the cloud environment in a highly automated manner
• Logging, metrics and alerting management.
• Creation of Bash/Python scripts for automation
• Performing root cause analysis for production errors.

• 2 years experience as Team Lead.
• Good Command on kubernetes.
• Proficient in Linux Commands line and troubleshooting.
• Proficient in AWS Services. Deployment, Monitoring and troubleshooting applications in AWS.
• Hands-on experience with CI tooling preferably with Jenkins.
• Proficient in deployment using Ansible.
• Knowledge of infrastructure management tools (Infrastructure as cloud) such as terraform, AWS cloud formation etc.
• Proficient in deployment of applications behind load balancers and proxy servers such as nginx, apache.
• Scripting languages: Bash, Python, Groovy.
• Experience with Logging, Monitoring, and Alerting tools like ELK(Elastic-search, Logstash, Kibana), Nagios. Graylog, splunk Prometheus, Grafana is a plus.

Requirements:

• Experience of managing Engineering teams in an Agile environment.
• Expert knowledge of delivering solutions in Azure cloud within a large-scale enterprise environment.
• Great understanding of DevOps principles and how they assist in taking products to market in an effective manner.
• Experience of Automation/Configuration management tools as well as working in a continuous delivery environment, monitoring and tooling.
• Knowledge and experience in Azure, Kubernetes, Containerisation, Azure DevOps pipelines.
• Experience in managing permissions in Azure DevOps.
• Working experience in Application Gateways, App Services, Front-Door, Azure Service Bus, etc.
• Troubleshooting experience in virtual/cloud infrastructures.
• Experience in delivery of projects using IAC (Infrastructure as Code).

• Cloud and virtualization-based technologies (Amazon Web Services (AWS), VMWare).
• Java Application Server Administration (Weblogic, WidlFfy, JBoss, Tomcat).
• Docker and Kubernetes (EKS)
• Linux/UNIX Administration (Amazon Linux and RedHat).
• Developing and supporting cloud infrastructure designs and implementations and guiding application development teams.
• Configuration Management tools (Chef or Puppet or ansible).
• Log aggregations tools such as Elastic and/or Splunk.
• Automate infrastructure and application deployment-related tasks using terraform.
• Automate repetitive tasks required to maintain a secure and up-to-date operational environment.

Responsibilities

• Build and support always-available private/public cloud-based software-as-a-service (SaaS) applications.
• Build AWS or other public cloud infrastructure using Terraform.
• Deploy and manage Kubernetes (EKS) based docker applications in AWS.
• Create custom OS images using Packer.
• Create and revise infrastructure and architectural designs and implementation plans and guide the implementation with operations.
• Liaison between application development, infrastructure support, and tools (IT Services) teams.
• Development and documentation of Chef recipes and/or ansible scripts. Support throughout the entire deployment lifecycle (development, quality assurance, and production).
• Help developers leverage infrastructure, application, and cloud platform features and functionality participate in code and design reviews, and support developers by building CI/CD pipelines using Bamboo, Jenkins, or Spinnaker.
• Create knowledge-sharing presentations and documentation to help developers and operations teams understand and leverage the system's capabilities.
• Learn on the job and explore new technologies with little supervision.
• Leverage scripting (BASH, Perl, Ruby, Python) to build required automation and tools on an ad-hoc basis.

Who we have in mind:

• Solid experience in building a solution on AWS or other public cloud services using Terraform.
• Excellent problem-solving skills with a desire to take on responsibility.
• Extensive knowledge in containerized application and deployment in Kubernetes
• Extensive knowledge of the Linux operating system, RHEL preferred.
• Proficiency with shell scripting.
• Experience with Java application servers.
• Experience with GiT and Subversion.
• Excellent written and verbal communication skills with the ability to communicate technical issues to non-technical and technical audiences.
• Experience working in a large-scale operational environment.
• Internet and operating system security fundamentals.
• Extensive knowledge of massively scalable systems. Linux operating system/application development desirable.
• Programming in scripting languages such as Python. Other object-oriented languages (C++, Java) are a plus.
• Experience with Configuration Management Automation tools (chef or puppet).
• Experience with virtualization, preferably on multiple hypervisors.
• BS/MS in Computer Science or equivalent experience.
• Excellent written and verbal skills.

Education or Equivalent Experience:

• Bachelor's degree or equivalent education in related fields
• Certificates of training in associated fields/equipment’s

DevOps Engineer responsibilities include deploying product updates, identifying production issues, and implementing integrations that meet customer needs. If you have a solid background in working with cloud technologies, set up efficient deployment processes, and are motivated to work with diverse and talented teams, we’d like to meet you.

Ultimately, you will execute and automate operational processes fast, accurately, and securely.

Skills and Experience

• 4+ years of experience in building infrastructure experience with Cloud Providers ( AWS, Azure, GCP)

• Experience in deploying containerized applications build on NodeJS/PHP/Python to kubernetes cluster.

• Experience in monitoring production workload with relevant metrics and dashboards.

• Experience in writing automation scripts using Shell, Python, Terraform, etc.

• Experience in following security practices while setting up the infrastructure. 

• Self-motivated, able, and willing to help where help is needed

• Able to build relationships, be culturally sensitive, have goal alignment, have learning agility  

Roles and Responsibilities

• Manage various resources across different cloud providers. (Azure, AWS, and GCP)

• Monitor and optimize infrastructure cost.

• Manage various kubernetes clusters with appropriate monitoring and alerting setup.

• Build CI/CD pipelines to orchestrate provisioning and deployment of various services into kubernetes infrastructure.

• Work closely with the development team on upcoming features to determine the correct infrastructure and related tools.

• Assist the support team with escalated customer issues.

• Develop, improve, and thoroughly document operational practices and procedures. 

• Responsible for setting up good security practices across various clouds.