MLOps Lead Engineer

Job Summary:

Seeking a seasoned SQL + ETL Developer with 4+ years of experience in managing large-scale datasets and cloud-based data pipelines. The ideal candidate is hands-on with MySQL, PySpark, AWS Glue, and ETL workflows, with proven expertise in AWS migration and performance optimization.

Key Responsibilities:

• Develop and optimize complex SQL queries and stored procedures to handle large datasets (100+ million records).
• Build and maintain scalable ETL pipelines using AWS Glue and PySpark.
• Work on data migration tasks in AWS environments.
• Monitor and improve database performance; automate key performance indicators and reports.
• Collaborate with cross-functional teams to support data integration and delivery requirements.
• Write shell scripts for automation and manage ETL jobs efficiently.

Required Skills:

• Strong experience with MySQL, complex SQL queries, and stored procedures.
• Hands-on experience with AWS Glue, PySpark, and ETL processes.
• Good understanding of AWS ecosystem and migration strategies.
• Proficiency in shell scripting.
• Strong communication and collaboration skills.

Nice to Have:

• Working knowledge of Python.
• Experience with AWS RDS.

About Company:

• Role Overview

• Senior Engineer with a strong background and experience in cloud related technologies and architectures. Can design target cloud architectures to transform existing architectures together with the in-house team. Can actively hands-on configure and build cloud architectures and guide others.

• Key Knowledge

• 3-5+ years of experience in AWS/GCP or Azure technologies
• Is likely certified on one or more of the major cloud platforms
• Strong experience from hands-on work with technologies such as Terraform, K8S, Docker and orchestration of containers.
• Ability to guide and lead internal agile teams on cloud technology
• Background from the financial services industry or similar critical operational experience

DevOps Lead Engineer

We are seeking a skilled DevOps Lead Engineer with 8 to 10 yrs. of experience who handles the entire DevOps lifecycle and is accountable for the implementation of the process. A DevOps Lead Engineer is liable for automating all the manual tasks for developing and deploying code and data to implement continuous deployment and continuous integration frameworks. They are also held responsible for maintaining high availability of production and non-production work environments.

Essential Requirements (must have):

• Bachelor's degree preferable in Engineering.

• Solid 5+ experience with AWS, DevOps, and related technologies

Skills Required:

Cloud Performance Engineering

• Performance scaling in a Micro-Services environment

• Horizontal scaling architecture

• Containerization (such as Dockers) & Deployment

• Container Orchestration (such as Kubernetes) & Scaling

DevOps Automation

• End to end release automation.

• Solid Experience in DevOps tools like GIT, Jenkins, Docker, Kubernetes, Terraform, Ansible, CFN etc.

• Solid experience in Infra Automation (Infrastructure as Code), Deployment, and Implementation.

• Candidates must possess experience in using Linux, Jenkins, and ample experience in Configuring and automating the monitoring tools.

• Strong scripting knowledge

• Strong analytical and problem-solving skills.

• Cloud and On-prem deployments

Infrastructure Design & Provisioning

• Infra provisioning.

• Infrastructure Sizing

• Infra Cost Optimization

• Infra security

• Infra monitoring & site reliability.

Job Responsibilities:

• Responsible for creating software deployment strategies that are essential for the successful

deployment of software in the work environment and provide stable environment for delivery of

quality.

• The DevOps Lead Engineer is accountable for designing, building, configuring, and optimizing

automation systems that help to execute business web and data infrastructure platforms.

• The DevOps Lead Engineer is involved in creating technology infrastructure, automation tools,

and maintaining configuration management.

• The Lead DevOps Engineer oversees and leads the activities of the DevOps team. They are

accountable for conducting training sessions for the juniors in the team, mentoring, career

support. They are also answerable for the architecture and technical leadership of the complete

DevOps infrastructure.

About Us -Celebal Technologies is a premier software services company in the field of Data Science, Big Data and Enterprise Cloud. Celebal Technologies helps you to discover the competitive advantage by employing intelligent data solutions using cutting-edge technology solutions that can bring massive value to your organization. The core offerings are around "Data to Intelligence", wherein we leverage data to extract intelligence and patterns thereby facilitating smarter and quicker decision making for clients. With Celebal Technologies, who understands the core value of modern analytics over the enterprise, we help the business in improving business intelligence and more data-driven in architecting solutions.

Key Responsibilities

•        As a part of the DevOps team, you will be responsible for configuration, optimization, documentation, and support of the CI/CD components.

•        Creating and managing build and release pipelines with Azure DevOps and Jenkins.

•        Assist in planning and reviewing application architecture and design to promote an efficient deployment process.

•        Troubleshoot server performance issues & handle the continuous integration system.

•        Automate infrastructure provisioning using ARM Templates and Terraform.

•        Monitor and Support deployment, Cloud-based and On-premises Infrastructure.

•        Diagnose and develop root cause solutions for failures and performance issues in the production environment.

•        Deploy and manage Infrastructure for production applications

•        Configure security best practices for application and infrastructure

Essential Requirements

•        Good hands-on experience with cloud platforms like Azure, AWS & GCP. (Preferably Azure)

•        Strong knowledge of CI/CD principles.

•        Strong work experience with CI/CD implementation tools like Azure DevOps, Team city, Octopus Deploy, AWS Code Deploy, and Jenkins.

•        Experience of writing automation scripts with PowerShell, Bash, Python, etc.

•        GitHub, JIRA, Confluence, and Continuous Integration (CI) system.

•        Understanding of secure DevOps practices

Good to Have -

•        Knowledge of scripting languages such as PowerShell, Bash

•        Experience with project management and workflow tools such as Agile, Jira, Scrum/Kanban, etc.

•        Experience with Build technologies and cloud services. (Jenkins, TeamCity, Azure DevOps, Bamboo, AWS Code Deploy)

•        Strong communication skills and ability to explain protocol and processes with team and management.

•        Must be able to handle multiple tasks and adapt to a constantly changing environment.

•        Must have a good understanding of SDLC.

•        Knowledge of Linux, Windows server, Monitoring tools, and Shell scripting.

•        Self-motivated; demonstrating the ability to achieve in technologies with minimal supervision.

•        Organized, flexible, and analytical ability to solve problems creatively.

ApnaComplex is one of India’s largest and fastest-growing PropTech disruptors within the Society & Apartment Management business.  The SaaS based B2C platform is headquartered out of India’s tech start-up hub, Bangalore, with branches in 6 other cities. It currently empowers 3,600 Societies, managing over 6 Lakh Households in over 80 Indian cities to effortlessly manage all aspects of running large complexes seamlessly.

ApnaComplex is part of ANAROCK Group. ANAROCK Group is India's leading specialized real estate services company having diversified interests across the real estate value chain.

If it excites you to - drive innovation, create industry-first solutions, build new capabilities ground-up, and work with multiple new technologies, ApnaComplex is the place for you.

Must have-

• Knowledge of Docker
• Knowledge of Terraforms
• Knowledge of AWS

Good to have -

• Kubernetes
• Scripting language: PHP/Go Lang and Python
• Webserver knowledge
• Logging and monitoring experience
• Test, build, design, deployment, and ability to maintain continuous integration and continuous delivery process using tools like Jenkins, maven Git, etc. 
• Build and maintain highly available production systems.
• Must know how to choose the best tools and technologies which best fits the business needs. 
• Develop software to integrate with internal back-end systems.
• Investigate and resolve technical issues.
• Problem-solving attitude.
• Ability to automate test and deploy the code and monitor. 
• Work in close coordination with the development and operations team such that the application is in line with performance according to the customer's expectation.
• Lead and guide the team in identifying and implementing new technologies.

Skills that will help you build a success story with us

• An ability to quickly understand and solve new problems
• Strong interpersonal skills
• Excellent data interpretation
• Context-switching
• Intrinsically motivated
• A tactical and strategic track record for delivering research-driven results

Quick Glances:

• https://www.apnacomplex.com/why-apnacomplex">What to look for at ApnaComplex
• https://www.linkedin.com/company/1070467/admin/">Who are we A glimpse of ApnaComplex, know us better
• https://www.apnacomplex.com/media-buzz">ApnaComplex - Media – Visit our media page  

ANAROCK Ethos - Values Over Value:

Our assurance of consistent ethical dealing with clients and partners reflects our motto - Values Over Value.

We value diversity within ANAROCK Group and are committed to offering equal opportunities in employment. We do not discriminate against any team member or applicant for employment based on nationality, race, color, religion, caste, gender identity / expression, sexual orientation, disability, social origin and status, indigenous status, political opinion, age, marital status or any other personal characteristics or status. ANAROCK Group values all talent and will do its utmost to hire, nurture and grow them.

Requirements:-

• Bachelor’s Degree or Master’s in Computer Science, Engineering,Software Engineering or a relevant field. 
• Strong experience with Windows/Linux-based infrastructures, Linux/Unix administration.
• knowledge of Jira, Bitbucket, Jenkins, Xray, Ansible, Windows and  .Net. as their Core Skill.
• Strong experience with databases such as SQL, MS SQL, MySQL, NoSQL.
• Knowledge of scripting languages such as Shell Scripting /Python/ PHP/Groovy, Bash.  
• Experience with project management and workflow tools such as   Agile, Jira / WorkFront etc.
• Experience with open-source technologies and cloud services.
• Experience in working with Puppet or Chef for automation and configuration.
• Strong communication skills and ability to explain protocol and processes with team  and management.  
• Experience in a DevOps Engineer role (or similar role)
• AExperience in software development and infrastructure development is a plus

Job Specifications:-

• Building and maintaining tools, solutions and micro services associated with deployment and our operations platform, ensuring that all meet our customer service standards and reduce errors.  
• Actively troubleshoot any issues that arise during testing and production, catching and solving issues before launch.
• Test our system integrity, implemented designs, application developments and other processes related to infrastructure, making improvements as needed
• Deploy product updates as required while implementing integrations when they arise.  
• Automate our operational processes as needed, with accuracy and in compliance with our security requirements.
• Specifying, documenting and developing new product features, and writing automating scripts.  Manage code deployments, fixes, updates and related processes.
• Work with open-source technologies as needed.
• Work with CI and CD tools, and source control such as GIT and SVN.
• Lead the team through development and operations.
• Offer  technical support where needed, developing software for our back-end systems.

• Define and document best practices and strategies regarding application deployment and infrastructure maintenance.
• Ensure limited system failure and increase up-time and availability of the various company apps.
• Understand the current application infrastructure and strive for making it better.
• Automate infrastructure and develop tools and processes to improve the customer experience and reduce support time.
• Work closely with a team of developers and solution strategists to develop, deploy and troubleshoot the deployment and infrastructure issues.
• Manage full application stacks from the OS through custom applications using Amazon cloud-based computing environments.
• Set up a monitoring stack.
• Implement the application’s CI/CD pipeline using the AWS stack. Increasingly automate and improve the testing plans and development workflows and tools.
• Work closely with the engineers to design networks, systems, and storage environments that effectively reflect business needs, security requirements, and service level requirements.
• Manage a continuous integration/continuous deployment methodology for the server-based technologies.
• Proficient in leveraging CI and CD tools to automate testing and deployment. Experience working in an Agile, fast-paced, DevOps environment.
• Support internal and external customers on multiple platforms.
• First point of contact for handling customer issues, providing guidance and recommendations to increase efficiency and reduce customer incidents.
• Learn on the job and explore new technologies with little supervision.
• In addition to providing customer support, will be responsible for helping build tools and processes necessary for excellent customer outcomes.

Skills:

• Experience with the core AWS services, plus the specifics mentioned in this job description.
• Experience working with at least one of the following languages: Node.js, Python, PHP, Ruby, Kotlin or Java.
• Proficient with Git and Git workflows and hosted enterprise Git solutions like GitHub.
• Ability to troubleshoot distributed systems.
• Experience with. AWS EKS Kubernetes infrastructure setup.
• Experience creating Cloud Formation Template to create Auto Scaling Groups, Route 53, DNS, back-end database, Elastic load balancer, VPCs, Subnets, Security Groups, Cloud Watch, S3, IAM roles, RDS DB instances, and to provide those instances and configure those resources to work together reducing the manual effort.
• Experience in deploying and monitoring microservices on Kubernetes, AWS ECS, and AWS EKS
• Security aware and ensures that all systems are security standards-compliant.
• Good background in Linux/Unix administration.
• Experience with building or maintaining cloud-native applications.
• Minimum 3-5 years of cloud development experience, preferably AWS
• Experience with CI/CD tools like Jenkins preferred.
• Good analytical and communication skills
• Bachelor’s Degree in Computer Science, Engineering or a related technical discipline

Opening for a Java Developer with Devops experience

Experience required: 5 yrs to 10 yrs

Essential Required Skills:

Familiarity with Version Control such as GitHub, BitBucket

• Java programmer(Liferay, Alfresco will add plus point)
• AWS
• OPs(ansible, apache, python, terraform)
• Effective communication skills
• An analytical bent of mind and problem-solving aptitude
• Good time management skills 
• Curiosity for learning 
• Patience

Roles & Responsibilities:

• Candidate with good hand on exposure on AWS, Cloud, Devops, Ansible, Docker, Jekins.
• Strong proficiency in Linux, Open Source, Web based and Cloud based environments (ability to use open source technologies and tools)
• Strong scripting and automation (bash, Perl, common Linux utils), strong grasp of automation tools a plus.
• Strong debugging skills (OS, scripting, Web based technologies), SQL, Java and Database concepts are a plus
• Apache, nginx, git, svn, GNU tools
• Must have exposure on Grep, awk, sed, Git, svn
• Scripting (bash, python)
• API related skills (REST, and any other like google, aws, atlassian)
• Web based technology
• Strong Unix Skills
• Java programmer, Coding (Springboot, Microservices, Liferay, Alfresco will add plus point)
• Proficient in AWS
• Ops (ansible, apache, python, terraform)

Benefits

• Cash Rewards & Recognition on Monthly Basis
• Work-Life Balance (Flexible Working Hours)
• Five-Day Work Week