DevOps Engineer

Job Summary:

Seeking a seasoned SQL + ETL Developer with 4+ years of experience in managing large-scale datasets and cloud-based data pipelines. The ideal candidate is hands-on with MySQL, PySpark, AWS Glue, and ETL workflows, with proven expertise in AWS migration and performance optimization.

Key Responsibilities:

• Develop and optimize complex SQL queries and stored procedures to handle large datasets (100+ million records).
• Build and maintain scalable ETL pipelines using AWS Glue and PySpark.
• Work on data migration tasks in AWS environments.
• Monitor and improve database performance; automate key performance indicators and reports.
• Collaborate with cross-functional teams to support data integration and delivery requirements.
• Write shell scripts for automation and manage ETL jobs efficiently.

Required Skills:

• Strong experience with MySQL, complex SQL queries, and stored procedures.
• Hands-on experience with AWS Glue, PySpark, and ETL processes.
• Good understanding of AWS ecosystem and migration strategies.
• Proficiency in shell scripting.
• Strong communication and collaboration skills.

Nice to Have:

• Working knowledge of Python.
• Experience with AWS RDS.

Infrastructure as Code (IaC):

• Design, implement, and maintain infrastructure as code using tools like Terraform, CloudFormation, or similar.
• Automate infrastructure provisioning and configuration across multiple environments (development, staging, production).

CI/CD Pipelines:

• Design, build, and maintain robust CI/CD pipelines using tools like Jenkins, GitLab CI/CD, CircleCI, or GitHub Actions.
• Implement automated testing, build, and deployment processes.
• Optimize pipelines for speed, reliability, and security.

Cloud Infrastructure:

• Manage and optimize cloud infrastructure on platforms like AWS, Azure, or GCP.
• Monitor and troubleshoot cloud infrastructure performance and availability.
• Implement security best practices for cloud environments.
• Implement cost optimization strategies for cloud resources.

1. Design cloud infrastructure that is secure, scalable, and highly available on AWS, Azure and GCP
2. Work collaboratively with software engineering to define infrastructure and deployment requirements
3. Provision, configure and maintain AWS, Azure, GCP cloud infrastructure defined as code
4. Ensure configuration and compliance with configuration management tools
5. Administer and troubleshoot Linux based systems
6. Troubleshoot problems across a wide array of services and functional areas
7. Build and maintain operational tools for deployment, monitoring, and analysis of AWS, Azure Infrastructure and systems
8. Perform infrastructure cost analysis and optimization

What we look for:

As a DevOps Developer, you will contribute to a thriving and growing AIGovernance Engineering team. You will work in a Kubernetes-based microservices environment to support our bleeding-edge cloud services. This will include custom solutions, as well as open source DevOps tools (build and deploy automation, monitoring and data gathering for our software delivery pipeline). You will also be contributing to our continuous improvement and continuous delivery while increasing maturity of DevOps and agile adoption practices.

Responsibilities:

• Ability to deploy software using orchestrators /scripts/Automation on Hybrid and Public clouds like AWS
• Ability to write shell/python/ or any unix scripts
• Working Knowledge on Docker & Kubernetes
• Ability to create pipelines using Jenkins or any CI/CD tool and GitOps tool like ArgoCD
• Working knowledge of Git as a source control system and defect tracking system
• Ability to debug and troubleshoot deployment issues
• Ability to use tools for faster resolution of issues
• Excellent communication and soft skills
• Passionate and ability work and deliver in a multi-team environment
• Good team player
• Flexible and quick learner
• Ability to write docker files, Kubernetes yaml files / Helm charts
• Experience with monitoring tools like Nagios, Prometheus and visualisation tools such as Grafana.
• Ability to write Ansible, terraform scripts
• Linux System experience and Administration
• Effective cross-functional leadership skills: working with engineering and operational teams to ensure systems are secure, scalable, and reliable.
• Ability to review deployment and operational environments, i.e., execute initiatives to reduce failure, troubleshoot issues across the entire infrastructure stack, expand monitoring capabilities, and manage technical operations.

• Understanding of maintenance of existing systems (Virtual machines), Linux stack
• Experience running, operating and maintainence of Kubernetes pods
• Strong Scripting skills
• Experience in AWS
• Knowledge of configuring/optimizing open source tools like Kafka, etc.
• Strong automation maintenance - ability to identify opportunities to speed up build and deploy process with strong validation and automation
• Optimizing and standardizing monitoring, alerting.
• Experience in Google cloud platform
• Experience/ Knowledge  in Python will be an added advantage
• Experience on Monitoring Tools like Jenkins, Kubernetes ,Terraform  etc

**THIS IS A 100% WORK FROM OFFICE ROLE**

We are looking for an experienced DevOps engineer that will help our team establish DevOps practice. You will work closely with the technical lead to identify and establish DevOps practices in the company.
You will help us build scalable, efficient cloud infrastructure. You’ll implement monitoring for automated system health checks. Lastly, you’ll build our CI pipeline, and train and guide the team in DevOps practices.

ROLE and RESPONSIBILITIES:

• Understanding customer requirements and project KPIs
• Implementing various development, testing, automation tools, and IT infrastructure
• Planning the team structure, activities, and involvement in project management
activities.
• Managing stakeholders and external interfaces
• Setting up tools and required infrastructure
• Defining and setting development, test, release, update, and support processes for
DevOps operation
• Have the technical skill to review, verify, and validate the software code developed in
the project.
• Troubleshooting techniques and fixing the code bugs
• Monitoring the processes during the entire lifecycle for its adherence and updating or
creating new processes for improvement and minimizing the wastage
• Encouraging and building automated processes wherever possible
• Identifying and deploying cybersecurity measures by continuously performing
vulnerability assessment and risk management
• Incidence management and root cause analysis
• Coordination and communication within the team and with customers
• Selecting and deploying appropriate CI/CD tools
• Strive for continuous improvement and build continuous integration, continuous
development, and constant deployment pipeline (CI/CD Pipeline)
• Mentoring and guiding the team members
• Monitoring and measuring customer experience and KPIs
• Managing periodic reporting on the progress to the management and the customer

Essential Skills and Experience Technical Skills

• Proven 3+years of experience as DevOps
• A bachelor’s degree or higher qualification in computer science
• The ability to code and script in multiple languages and automation frameworks
like Python, C#, Java, Perl, Ruby, SQL Server, NoSQL, and MySQL
• An understanding of the best security practices and automating security testing and
updating in the CI/CD (continuous integration, continuous deployment) pipelines
• An ability to conveniently deploy monitoring and logging infrastructure using tools.
• Proficiency in container frameworks
• Mastery in the use of infrastructure automation toolsets like Terraform, Ansible, and command line interfaces for Microsoft Azure, Amazon AWS, and other cloud platforms
• Certification in Cloud Security
• An understanding of various operating systems
• A strong focus on automation and agile development
• Excellent communication and interpersonal skills
• An ability to work in a fast-paced environment and handle multiple projects
simultaneously

OTHER INFORMATION

The DevOps Engineer will also be expected to demonstrate their commitment:
• to gedu values and regulations, including equal opportunities policy.
• the gedu’s Social, Economic and Environmental responsibilities and minimise environmental impact in the performance of the role and actively contribute to the delivery of gedu’s Environmental Policy.
• to their Health and Safety responsibilities to ensure their contribution to a safe and secure working environment for staff, students, and other visitors to the campus.

Total Experience: 6 – 12 Years

Required Skills and Experience 

• 3+ years of relevant experience with DevOps tools Jenkins, Ansible, Chef etc
• 3+ years of experience in continuous integration/deployment and software tools development experience with Python and shell scripts etc
• Building and running Docker images and deployment on Amazon ECS
• Working with AWS services (EC2, S3, ELB, VPC, RDS, Cloudwatch, ECS, ECR, EKS)
• Knowledge and experience working with container technologies such as Docker and Amazon ECS, EKS, Kubernetes
• Experience with source code and configuration management tools such as Git, Bitbucket, and Maven
• Ability to work with and support Linux environments (Ubuntu, Amazon Linux, CentOS)
• Knowledge and experience in cloud orchestration tools such as AWS Cloudformation/Terraform etc
• Experience with implementing "infrastructure as code", “pipeline as code” and "security as code" to enable continuous integration and delivery
• Understanding of IAM, RBAC, NACLs, and KMS
• Good communication skills

Good to have:

• Strong understanding of security concepts, methodologies and apply them such as SSH, public key encryption, access credentials, certificates etc.
• Knowledge of database administration such as MongoDB.
• Knowledge of maintaining and using tools such as Jira, Bitbucket, Confluence.

Responsibilities

• Work with Leads and Architects in designing and implementation of technical infrastructure, platform, and tools to support modern best practices and facilitate the efficiency of our development teams through automation, CI/CD pipelines, and ease of access and performance.
• Establish and promote DevOps thinking, guidelines, best practices, and standards.
• Contribute to architectural discussions, Agile software development process improvement, and DevOps best practices.