Sr DevOps Lead

Job Summary:

Seeking a seasoned SQL + ETL Developer with 4+ years of experience in managing large-scale datasets and cloud-based data pipelines. The ideal candidate is hands-on with MySQL, PySpark, AWS Glue, and ETL workflows, with proven expertise in AWS migration and performance optimization.

Key Responsibilities:

• Develop and optimize complex SQL queries and stored procedures to handle large datasets (100+ million records).
• Build and maintain scalable ETL pipelines using AWS Glue and PySpark.
• Work on data migration tasks in AWS environments.
• Monitor and improve database performance; automate key performance indicators and reports.
• Collaborate with cross-functional teams to support data integration and delivery requirements.
• Write shell scripts for automation and manage ETL jobs efficiently.

Required Skills:

• Strong experience with MySQL, complex SQL queries, and stored procedures.
• Hands-on experience with AWS Glue, PySpark, and ETL processes.
• Good understanding of AWS ecosystem and migration strategies.
• Proficiency in shell scripting.
• Strong communication and collaboration skills.

Nice to Have:

• Working knowledge of Python.
• Experience with AWS RDS.

Infrastructure as Code (IaC):

• Design, implement, and maintain infrastructure as code using tools like Terraform, CloudFormation, or similar.
• Automate infrastructure provisioning and configuration across multiple environments (development, staging, production).

CI/CD Pipelines:

• Design, build, and maintain robust CI/CD pipelines using tools like Jenkins, GitLab CI/CD, CircleCI, or GitHub Actions.
• Implement automated testing, build, and deployment processes.
• Optimize pipelines for speed, reliability, and security.

Cloud Infrastructure:

• Manage and optimize cloud infrastructure on platforms like AWS, Azure, or GCP.
• Monitor and troubleshoot cloud infrastructure performance and availability.
• Implement security best practices for cloud environments.
• Implement cost optimization strategies for cloud resources.

Key Responsibilities:

• Work with the development team to plan, execute and monitor deployments
• Capacity planning for product deployments
• Adopt best practices for deployment and monitoring systems
• Ensure the SLAs for performance, up time are met
• Constantly monitor systems, suggest changes to improve performance and decrease costs.
• Ensure the highest standards of security

Key Competencies (Functional):

• Proficiency in coding in atleast one scripting language - bash, Python, etc
• Has personally managed a fleet of servers (> 15)
• Understand different environments production, deployment and staging
• Worked in micro service / Service oriented architecture systems
• Has worked with automated deployment systems – Ansible / Chef / Puppet.
• Can write MySQL queries

Key Sills Required for Lead DevOps Engineer

Containerization Technologies

Docker, Kubernetes, OpenShift

Cloud Technologies

AWS/Azure, GCP

CI/CD Pipeline Tools

Jenkins, Azure Devops

Configuration Management Tools

Ansible, Chef,

SCM Tools

Git, GitHub, Bitbucket

Monitoring Tools

New Relic, Nagios, Prometheus

Cloud Infra Automation

Terraform

Scripting Languages

Python, Shell, Groovy

·       Ability to decide the Architecture for the project and tools as per the availability

·       Sound knowledge required in the deployment strategies and able to define the timelines

·       Team handling skills are a must

·       Debugging skills are an advantage

·       Good to have knowledge of Databases like Mysql, Postgresql

It is advantageous to be familiar with Kafka. RabbitMQ

·       Good to have knowledge of Web servers to deploy web applications

·       Good to have knowledge of Code quality checking tools like SonarQube and Vulnerability scanning

·       Advantage to having experience in DevSecOps

Note: Tools mentioned in bold are a must and others are added advantage

Come Dive In

The DevOps Engineer will execute the tools and processes to enable DevOps.

Engage in and improve the whole lifecycle of services from inception and design through deployment, operation, and refinement to efficiently deliver high-quality solutions. The candidate should bridge the gap between Development and Operational teams, working with the development teams to meet acceptance criteria and gather and document the requirements. Candidates should be able to work in fast-paced,
multi-disciplinary environments.

As An DevOps Engineer, You Will

● Work in a dynamic, agile team environment developing excellent new applications.
● Participate in design decisions, including new technology research and prototyping
● Collaborate closely with other AWS engineers and architects, cloud engineers, support teams, and other stakeholders
● Promote great Kubernetes and AWS platform design and quality
● Innovate new ideas to evolve our applications and processes
● Continuously analyzing and evaluating our systems, products, and methods for potential improvements.

Mandatory Skills:

● Experience on Linux based infrastructure
● Experience in ECS - Amazon services*
● Should have hands-on containerized Services
● Must know about AWS CI/CD pipeline.
● Must know DevOps concepts and Agile principles
● Knowledge of Git, Docker, and Jenkins
● Knowledge of Infrastructure as Code.
● Experience in using Automation Tools
● Must have experience in Test Driven Development environment setup.
● Working knowledge of Docker and Kubernetes
We recognize that asking you to give 100% of yourself daily requires us to show you the love.

PERKS: what can we offer you?

● Bi-Yearly performance audits and appraisals
● The flexibility of working days/hours
● 5 working days/week (Mon to Fri) and added payout for working Saturday
● Recognition and Appreciation
● A plethora of industry exposure and self-growth opportunities

Visit our site: www.cedcoss.com

About Us:

Varivas is a community that allows users to create, support, and recommend content. The mission of Varivas is to give community freedom, ease, and complete control of their content.

Varivas is an early-stage startup looking for its first few members.

 https://www.varivas.community/

Become part of a core team of an upcoming startup building an exciting product from scratch.

Your Responsibilities:

• Write scalable backend code and audit existing backend code for sanity, performance and security
• Design and implementation of on-demand scalable, and performant applications.
• Defining and setting development, test, release, update, and support processes for DevOps operation
• Incidence management and root cause analysis
• Selecting and deploying appropriate CI/CD tools for various test automation frameworks
• Monitoring the processes during the entire lifecycle Encouraging and building automated processes wherever possible
• Identifying and deploying cybersecurity measures by continuously performing vulnerability assessment and risk management
• Achieve repeatability, fast recovery, best practices, and delegate proper ownership permissions to teams
• Analyzes the technology currently being used and develops plans and processes for improvement and expansion for better cost and efficiency
• Collaborate with and assist QA in performing load tests and assessing performance optimization
• writing and maintaining the DevOps processes in tools such as confluence

We are looking for someone who is:

• Ready to take complete ownership of the whole infra at Varivas
• Has previous experience in building and maintaining live production app
• You have an eye for detail.
• You’re a problem solver and a perpetual learner.
• You possess a positive and solution-oriented mindset.
• Good Problem-solving skills and troubleshooting
• Build high-performing web and native applications that are robust and easy to maintain

Our Current DevOps stack:

• Github/bitbucket
• Azure cloud storage
• MongoDB Atlas
• JIRA
• Selenium, cypress test automation
• Heroku/digital ocean
• GoDaddy
• Google Analytics/search console
• SendGrid
• sentry.io
• hotjar

What we can offer:

• Payment for work done (of course 🙂)
• Remote work from anywhere
• part time or full time engagement
• Complete flexibility of working hours
• Complete freedom and ownership of your work
• No meetings, standups, or daily status group calls. (We prefer asynchronous communication like slack)

• Expertise in Infrastructure & Application design & architecture
• Expertise in AWS, OS & networking
• Having good exposure on Infra & Application security
• Expertise in Python, Shell scripting
• Proficient with Devops tools Terraform, Jenkins, Ansible, Docker, GIT
• Solid background in systems engineering and operations
• Strong in Devops methodologies and processes
• Strong in CI/CD pipeline & SDLC.