Devops Architect

Job Summary:

Seeking a seasoned SQL + ETL Developer with 4+ years of experience in managing large-scale datasets and cloud-based data pipelines. The ideal candidate is hands-on with MySQL, PySpark, AWS Glue, and ETL workflows, with proven expertise in AWS migration and performance optimization.

Key Responsibilities:

• Develop and optimize complex SQL queries and stored procedures to handle large datasets (100+ million records).
• Build and maintain scalable ETL pipelines using AWS Glue and PySpark.
• Work on data migration tasks in AWS environments.
• Monitor and improve database performance; automate key performance indicators and reports.
• Collaborate with cross-functional teams to support data integration and delivery requirements.
• Write shell scripts for automation and manage ETL jobs efficiently.

Required Skills:

• Strong experience with MySQL, complex SQL queries, and stored procedures.
• Hands-on experience with AWS Glue, PySpark, and ETL processes.
• Good understanding of AWS ecosystem and migration strategies.
• Proficiency in shell scripting.
• Strong communication and collaboration skills.

Nice to Have:

• Working knowledge of Python.
• Experience with AWS RDS.

1. Design cloud infrastructure that is secure, scalable, and highly available on AWS, Azure and GCP
2. Work collaboratively with software engineering to define infrastructure and deployment requirements
3. Provision, configure and maintain AWS, Azure, GCP cloud infrastructure defined as code
4. Ensure configuration and compliance with configuration management tools
5. Administer and troubleshoot Linux based systems
6. Troubleshoot problems across a wide array of services and functional areas
7. Build and maintain operational tools for deployment, monitoring, and analysis of AWS, Azure Infrastructure and systems
8. Perform infrastructure cost analysis and optimization

• Strong experience working with tools and platforms like Helm charts, Circle CI, Jenkins,
• and/or Codefresh
• Excellent knowledge of AWS offerings around Cloud and DevOps
• Strong expertise in containerization platforms like Docker and container orchestration platforms like Kubernetes & Rancher
• Should be familiar with leading Infrastructure as Code tools such as Terraform, CloudFormation, etc.
• Strong experience in Python, Shell Scripting, Ansible, and Terraform
• Good command over monitoring tools like Datadog, Zabbix, Elk, Grafana, CloudWatch, Stackdriver, Prometheus, JFrog, Nagios, etc.
• Experience with Linux/Unix systems administration.

• Responsible for the entire infrastructure including Production (both bare metal and AWS).
• Manage and maintain the production systems and operations including SysAdmin, DB activities.
• Improve tools and processes, automate manual efforts, and maintain the health of the system.
• Champion best practices, CI-CD, Metrics Driven Development
• Optimise the company's computing architecture
• Conduct systems tests for security, performance, and availability
• Maintain security of the system
• Develop and maintain design and troubleshooting documentation

• 7+ years of experience into DevOps/Technical Operations
• Extensive experience in operating scripting language like shell, python, etc
• Experience in developing and maintaining CI/CD process for SaaS applications using tools such as Jenkins
• Hands on experience in using configuration management tools such as Puppet, SaltStack, Ansible, etc
• Hands-on experience to build and handle VMs, Containers utilizing tools such as Kubernetes, Docker, etc
• Hands on experience in building, designing and maintaining cloud-based applications with AWS, Azure,GCP, etc
• Knowledge of Databases (MySQL, NoSQL)
• Knowledge of security/ethical hacking

• Have experience with ElasticSearch, Kibana, LogStash
• Have experience with Cassandra, Hadoop, or Spark
• Have experience with Mongo, Hive

• Defining and documenting best practices and strategies regarding application deployment and infrastructure maintenance
• Providing guidance, thought leadership and mentorship to development teams to build cloud competencies
• Ensuring application performance, uptime, and scale, maintaining high standards of code quality and thoughtful design
• Managing cloud environments in accordance with company security guidelines
• Developing and implementing technical efforts to design, build and deploy AWS applications at the direction of lead architects, including large-scale data processing, computationally intensive statistical modeling and advanced analytics
• Participating in all aspects of the software development life cycle for AWS solutions, including planning, requirements, development, testing, and quality assurance
• Troubleshooting incidents, identifying root cause, fixing and documenting problems and implementing preventive measures
• Educating teams on the implementation of new cloud-based initiatives, providing associated training as required

Desired Candidate Profile

• Bachelor’s degree in computer science, information technology
• 2+ years of experience as architect, designing, developing, and implementing cloud solutions on AWS platforms
• Experience in several of the following areas: database architecture, ETL, business intelligence, big data, machine learning, advanced analytic
• Proven ability to collaborate with multi-disciplinary teams of business analysts, developers, data scientists and subject matter experts
• Self-motivation with the ability to drive features to delivery
• Strong analytical and problem solving skills
• Excellent oral and written communication skills
• Good logical sense, strong technical skills and the ability to learn new technologies quickly
• AWS certifications are a plus
• Knowledge of web services, API, REST, and RPC    

Skills:

• Strong working knowledge of AWS.
• Implements AWS cloud platform.
• Infrastructure as Code, GitLab CI/CD, and DevOps standard methodologies
• scripting in Shell, Python, Ruby or any preferred scripting language

Terraform expertise is a MUST for this role.

a short exercise on terraform to all shortlisted candidates to demonstrate their hands-on skills on terraform before rolling out the offer

Desired Profile

 Providing expertise on all matters related to CI, CD and DevOps.

 Building and maintaining highly available production systems.

 Developing and maintaining release related documents, such as release plan, release notes etc.

 Ensuring quality releases and managing release and configuration change conflicts to resolution.

 Tracking release and publishing release notes.  Investigating and resolving technical issues by deploying updates/ fixes.

 Onboard applications to DevOps process.

 Setup and configure build jobs.

 Create automated deployment scripts.

 Configure JIRA workflow, and integrate with Jenkins / Micro-services.

Qualification

 Degree/Diploma in Computer Science, Engineering or related field and have previous experience as a DevOps Engineer.

 AWS Certification will be a plus.

 Experience of automation and provisioning approaches, using tools such as Terraform & Cloud Formation

Skillset Required

 Solid experience within release management, infra architecture, CI&CD.

 Highly goal driven and work well in fast paced environments.

 Proven experience of using Jenkins, Unix Shell Commands, Container technology (Docker, Kubernetes),

Java Programming, Groovy Script, Git, Code Branching Strategy, Maven, Gradle, JIRA, ECS, OpenShift.