Kubernetes Engineer - Freelancer

Job Summary:

Seeking a seasoned SQL + ETL Developer with 4+ years of experience in managing large-scale datasets and cloud-based data pipelines. The ideal candidate is hands-on with MySQL, PySpark, AWS Glue, and ETL workflows, with proven expertise in AWS migration and performance optimization.

Key Responsibilities:

• Develop and optimize complex SQL queries and stored procedures to handle large datasets (100+ million records).
• Build and maintain scalable ETL pipelines using AWS Glue and PySpark.
• Work on data migration tasks in AWS environments.
• Monitor and improve database performance; automate key performance indicators and reports.
• Collaborate with cross-functional teams to support data integration and delivery requirements.
• Write shell scripts for automation and manage ETL jobs efficiently.

Required Skills:

• Strong experience with MySQL, complex SQL queries, and stored procedures.
• Hands-on experience with AWS Glue, PySpark, and ETL processes.
• Good understanding of AWS ecosystem and migration strategies.
• Proficiency in shell scripting.
• Strong communication and collaboration skills.

Nice to Have:

• Working knowledge of Python.
• Experience with AWS RDS.

Staff DevOps Engineer with Azure

EGNYTE YOUR CAREER. SPARK YOUR PASSION.

Egnyte is a place where we spark opportunities for amazing people. We believe that every role has meaning, and every Egnyter should be respected. With 22,000+ customers worldwide and growing, you can make an impact by protecting their valuable data. When joining Egnyte, you’re not just landing a new career, you become part of a team of Egnyters that are doers, thinkers, and collaborators who embrace and live by our values:

Invested Relationships

Fiscal Prudence

Candid Conversations

ABOUT EGNYTE

Egnyte is the secure multi-cloud platform for content security and governance that enables organizations to better protect and collaborate on their most valuable content. Established in 2008, Egnyte has democratized cloud content security for more than 22,000 organizations, helping customers improve data security, maintain compliance, prevent and detect ransomware threats, and boost employee productivity on any app, any cloud, anywhere. For more information, visit www.egnyte.com.

Our Production Engineering team enables Egnyte to provide customers access to their data 24/7 by providing best in class infrastructure.

ABOUT THE ROLE

We store multibillion files and multiple petabytes of data. We observe more than 11K API requests per second on average. To make that possible and to provide the best possible experience, we rely on great engineers. For us, people who own their work, from start to finish, are integral. Our engineers are part of the process from design to code, to test, to deployment and back again for further iterations. You can, and will, touch every level of the infrastructure depending on the day and what project you are working on. The ideal candidate should be able to take a complex problem and execute end to end. Mentor and set higher standards for the rest of the team and for the new hires.

WHAT YOU’LL DO:

•  Design, build and maintain self-hosted and cloud environments to serve our own applications and services.

•  Collaborate with software developers to build stable, scalable and high-performance solutions.

•   Taking part in big projects like migrating solutions from self-hosted environments to the cloud, from virtual machines to Kubernetes, from monolith to microservices.

• Proactively make our organization and technology better!
• Advising others as to how DevOps can make a positive impact on their work.

•   Share knowledge, mentor more junior team members while also still learning and gaining new skills.

• Maintain​ ​consistently​ ​high​ ​standards​ ​of​ ​​communication,​ ​productivity, and teamwork​ ​across​ ​all​ ​teams.

YOUR QUALIFICATIONS:

•  5+ years of proven experience in a DevOps Engineer, System Administrator or Developer role, working on infrastructure or build processes.

•  Expert knowledge of Microsoft Azure.

•  Programming prowess (Python, Golang).

• Knowledge and experience about deployment and maintenance of Java and Python apps using application and web servers (Tomcat, Nginx, etc.).

• Ability to solve complex problems with simple, elegant and clean code.

• Practical knowledge of CI/CD solutions, GitLab CI or similar.

• Practical knowledge of Docker as a tool for testing and building an environment.

• Knowledge of Kubernetes and related technologies.

• Experience with metric-based monitoring solutions.

• Solid English skills to effectively communicate with other team members.

• Good understanding of the Linux Operating System on the administration level.

• Drive to grow as a DevOps Engineer (we value open-mindedness and a can-do attitude).

• Strong sense of ownership and ability to drive big projects.

BONUS SKILLS:

• Work experience as a Microsoft Azure architect.

• Experience in Cloud migrations projects.

• Leadership skills and experience.

COMMITMENT TO DIVERSITY, EQUITY, AND INCLUSION:

At Egnyte, we celebrate our differences and thrive on our diversity for our employees, our products, our customers, our investors, and our communities. Egnyters are encouraged to bring their whole selves to work and to appreciate the many differences that collectively make Egnyte a higher-performing company and a great place to be.

Role Introduction

• This role involves guiding the DevOps team towards successful delivery of Governance and

toolchain initiatives by removing manual tasks.

• Operate toolchain applications to empower engineering teams by providing, reliable, governed

self-service tools and supporting their adoption

• Driving good practice for consumption and utilisation of the engineering toolchain, with a focus

on DevOps practices

• Drive good governance for cloud service consumption

• Involves working in a collaborative environment and focus on leading team and providing

technical leadership to team members.

• Involves setting up process and improvements for teams on supporting various DevOps tooling

and governing the tooling.

• Co-ordinating with multiple teams within organization

• Lead on handovers from architecture teams to support major project rollouts which require the

Toolchain governance DevOps team to operationally support tooling

What you will do

• Identify and implement best practices, process improvement and automation initiatives for

improvement towards quicker delivery by removing manual tasks

• Ensure best practices and process are documented for reusability and keeping up-to date on

good practices and standards.

• Re-usable automation and compliance service, tools and processes

• Support and management of toolchain, toolchain changes and selection

• Identify and implement risk mitigation plans, avoid escalations, resolve blockers for teams.

Toolchain governance will involve operating and responding to alerts, enforcing good tooling

governance by driving automation, remediating technical debt and ensuring the latest tools

are utilised and on the latest versions

• Triage product pipelines, performance issues, SLA/SLO breaches, service unavailable along

with ancillary actions such as providing access to logs, tools, environments.

• Involve in initial / detailed estimates during roadmap planning or feature

estimation/planning of any automation identified for a given toolset.

• Develop, refine, and tune integrations between various tools

• Discuss with Product Owner/team on any challenges from implementation, deployment

perspective and assist in arriving probable solution and escalate any risks to get them

resolved w.r.t DevOps toolchain.

• In consultation with Head of DevOps and other stake holders, prioritization of items, item-

task breakdown; accountable for squad deliverables for sprint

• Involve in reviewing current components and plan for upgrade and ensure its communicated

to wider audience within Organization

• Involve in reviewing access / role and enhance and automate provisioning.

• Identify and encourage areas for growth and improvement within the team e.g conducts

regular 1-2-1’s with squad members to provide support, mentoring and goal setting

• Involve in performance management ,rewards and recognition of team members, Involve in

hiring process.• Plan for upskill of team to know about tools and perform tasks. Ensure quicker onboarding

of new joiners/freshers to team to be productive.

• Review ticket metrics to measure the health of the project including SLAs and plan for

improvement.

• Requirement for on call for critical incidents that happen Out of Hours, based on tooling SLA.

This may include planning standby schedule for squad, carrying out retrospective for every

callout and reviewing SLIs/SLOs.

• Owns the tech/repair debt, risk and compliance for the tooling with respect to

infrastructure, pipelines, access etc

• Track optimum utilization of resources and monitor/track the delivery schedule

• Review solutions designs with the Architects / Principal DevOps Engineers as required

• Provide monthly reporting which align to DevOps Tooling KPIs

What you will have

• Candidate should have 8+ years of experience and Hands-on DevOps experience and

experience in team management.

• Strong communication and interpersonal skills, Team player

• Good working experience of CI/CD tools like Jenkins, SonarQube, FOSSA, Harness, Jira, JSM,

ServiceNow etc.

• Good hands on knowledge of AWS Services like EC2, ECS, S3, IAM, SNS, SQS, VPC, Lambda,

API Gateway, Cloud Watch, Cloud Formation etc.

• Experience in operating and governing DevOps Toolchain

• Experience in operational monitoring, alerting and identifying and delivering on both repair

and technical debt

• Experience and background in ITIL/ITSM processes. The candidate will ensure development

of the appropriate (ITSM) model and processes, based on the ITIL Service Management

framework. This includes the strategic, design, transition, and operation services and

continuous service improvement

• Provide ITSM leadership experience and coaching processes

• Experience on various tools like Jenkins, Harness, Fossa,

• Experience of hosting and managing applications on AWS/AZURE•

• Experience in CI/CD pipeline (Jenkins build pipelines)

• Experience in containerization (Docker/Kubernetes)

• Experience in any programming language (Node.js or Python is preferred)

• Experience in Architecting and supporting cloud based products will be a plus

• Experience in PowerShell & Bash will be a plus

• Able to self manage multiple concurrent small projects, including managing priorities

between projects

• Able to quickly learn new tools

• Should be able to mentor/drive junior team members to achieve desired outcome of

roadmap-

• Ability to analyse information to identify problems and issues, and make effective decisions

within short span

• Excellent problem solving and critical thinking

• Experience in integrating various components including unit testing / CI/CD configuration.

• Experience to review current toolset and plan for upgrade.

• Experience with Agile framework/Jira/JSM tool.• Good communication skills and ability to communicate/work independently with external

teams.

• Highly motivated, able to work proficiently both independently and in a team environment

Good knowledge and experience with security constructs –

About Us -Celebal Technologies is a premier software services company in the field of Data Science, Big Data and Enterprise Cloud. Celebal Technologies helps you to discover the competitive advantage by employing intelligent data solutions using cutting-edge technology solutions that can bring massive value to your organization. The core offerings are around "Data to Intelligence", wherein we leverage data to extract intelligence and patterns thereby facilitating smarter and quicker decision making for clients. With Celebal Technologies, who understands the core value of modern analytics over the enterprise, we help the business in improving business intelligence and more data-driven in architecting solutions.

Key Responsibilities

•        As a part of the DevOps team, you will be responsible for configuration, optimization, documentation, and support of the CI/CD components.

•        Creating and managing build and release pipelines with Azure DevOps and Jenkins.

•        Assist in planning and reviewing application architecture and design to promote an efficient deployment process.

•        Troubleshoot server performance issues & handle the continuous integration system.

•        Automate infrastructure provisioning using ARM Templates and Terraform.

•        Monitor and Support deployment, Cloud-based and On-premises Infrastructure.

•        Diagnose and develop root cause solutions for failures and performance issues in the production environment.

•        Deploy and manage Infrastructure for production applications

•        Configure security best practices for application and infrastructure

Essential Requirements

•        Good hands-on experience with cloud platforms like Azure, AWS & GCP. (Preferably Azure)

•        Strong knowledge of CI/CD principles.

•        Strong work experience with CI/CD implementation tools like Azure DevOps, Team city, Octopus Deploy, AWS Code Deploy, and Jenkins.

•        Experience of writing automation scripts with PowerShell, Bash, Python, etc.

•        GitHub, JIRA, Confluence, and Continuous Integration (CI) system.

•        Understanding of secure DevOps practices

Good to Have -

•        Knowledge of scripting languages such as PowerShell, Bash

•        Experience with project management and workflow tools such as Agile, Jira, Scrum/Kanban, etc.

•        Experience with Build technologies and cloud services. (Jenkins, TeamCity, Azure DevOps, Bamboo, AWS Code Deploy)

•        Strong communication skills and ability to explain protocol and processes with team and management.

•        Must be able to handle multiple tasks and adapt to a constantly changing environment.

•        Must have a good understanding of SDLC.

•        Knowledge of Linux, Windows server, Monitoring tools, and Shell scripting.

•        Self-motivated; demonstrating the ability to achieve in technologies with minimal supervision.

•        Organized, flexible, and analytical ability to solve problems creatively.

• Extensive experience in designing & supporting Azure Managed Services Operations.  
• Maintaining the Azure Active Directory and Azure AD authentication. 
• Azure update management – Handling updates/Patching. 
• Good understanding of Azure services (Azure App Service, Azure SQL,  Azure Storage Account..etc). 
• Understanding of load balancers, DNS, virtual networks, NSG and firewalls in cloud environment. 
• ARM templates writing, setup automation for resources provisioning. 
• Knowledge on Azure automation and Automation Desire State Configuration. 
• Good understanding of High Availability and Auto scaling. 
• Azure Backups and ASR (Azure Site Recovery) 
• Azure Monitoring and Configuration monitoring (performance metrics, OMS) 
• Cloud Migration Experience(On premise to Cloud). 
• PowerShell scripting for custom tasks automation. 
• Strong experience in configuring, maintaining, and troubleshooting Microsoft based production systems. 
  
  Certification: 
  
  Azure Administrator (AZ-103) & Azure Architect (AZ-300 & AZ-301) 

Azure DeVops

On premises to Azure Migration

Docker, Kubernetes

Terraform CI CD pipeline

9+ Location

Budget – BG, Hyderabad, Remote , Hybrid –

Budget – up to 30 LPA

What you need to have:

• 3-6 years of relevant work experience in a DevOps role.
• Deep understanding of Amazon Web Services or equivalent cloud platforms.
• Proven record of infra automation and programming skills in any of these languages - Python, Ruby, Perl, Javascript.
• Implement DevOps Industry best practices and the application of procedures to achieve a continuously deployable system
• Continuously improve and increase the capabilities of the CI/CD pipeline
• Support engineering teams in the implementation of life-cycle infrastructure solutions and documentation operations in order to meet the engineering departments quality and standards
• Participate in production outages and handle complex issues and works towards resolution