MLOps Lead Engineer

DevOps Engineer

Our engineering team is looking for Big-Data DevOps engineers to join the engineering team and help us automate the build, release, packaging and infrastructure provisioning and support processes. The candidate is expected to own the full life-cycle of provisioning, configuration management, monitoring, maintenance and support for cloud as well as on premise deployments.

Responsibilities

• 3-plus years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase
• Deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run
• Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks
• Experience with middle-layer technologies including web servers (httpd, ningx),

application servers (Jboss, Tomcat) and database systems (postgres, mysql)

• Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.
• Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches
• Experience supporting on-premise solutions as well as on AWS cloud
• Experience working with and supporting Spark-based applications on YARN
• Experience with one or more automation tools such as Ansible, Terraform, etc
• Experience working with CI/CD tools like Jenkins and various test report and coverage Plugins
• Experience defining and automating the build, versioning and release processes for complex enterprise products
• Experience supporting clients remotely and on-site
• Experience working with and supporting Java- and Python-based tech stacks would be a Plus

Must Have -

a. Background working with Startups

b. Good knowledge of Kubernetes & Docker

c. Background working in Azure

What you’ll be doing

• Ensure that our applications and environments are stable, scalable, secure and performing as expected.
• Proactively engage and work in alignment with cross-functional colleagues to understand their requirements, contributing to and providing suitable supporting solutions.
• Develop and introduce systems to aid and facilitate rapid growth including implementation of deployment policies, designing and implementing new procedures, configuration management and planning of patches and for capacity upgrades
• Observability: ensure suitable levels of monitoring and alerting are in place to keep engineers aware of issues.
• Establish runbooks and procedures to keep outages to a minimum. Jump in before users notice that things are off track, then automate it for the future.
• Automate everything so that nothing is ever done manually in production.
• Identify and mitigate reliability and security risks. Make sure we are prepared for peak times,
• DDoS attacks and fat fingers.
• Troubleshoot issues across the whole stack - software, applications and network.
• Manage individual project priorities, deadlines, and deliverables as part of a self-organizing team.
• Learn and unlearn every day by exchanging knowledge and new insights, conducting constructive code reviews, and participating in retrospectives.

Requirements

• 2+ years extensive experience of Linux server administration include patching, packaging (rpm), performance tuning, networking, user management, and security.
• 2+ years of implementing systems that are highly available, secure, scalable, and self-healingon Azure cloud platform
• Strong understanding of networking, especially in cloud environments along with a good understanding of CICD.
• Prior experience implementing industry standard security best practices, including those recommended by Azure
• Proficiency with Bash, and any high-level scripting language.
• Basic working knowledge of observability stacks like ELK, prometheus, grafana, Signoz etc
• Proficiency with Infrastructure as Code and Infrastructure Testing, preferably using Pulumi/Terraform.
• Hands-on experience in building and administering VMs and Containers using tools such as Docker/Kubernetes.
• Excellent communication skills, spoken as well as written, with a demonstrated ability to articulate technical problems and projects to all stakeholders.

Job Responsibilities:

Work & Deploy updates and fixes Provide Level 2 technical support Support implementation of fully automated CI/CD pipelines as per dev requirement Follow the escalation process through issue completion, including providing documentation after resolution Follow regular Operations procedures and complete all assigned tasks during the shift. Assist in root cause analysis of production issues and help write a report which includes details about the failure, the relevant log entries, and likely root cause Setup of CICD frameworks (Jenkins / Azure DevOps Server), Containerization using Docker, etc Implement continuous testing, Code Quality, Security using DevOps tooling Build a knowledge base by creating and updating documentation for support

Skills Required:

DevOps, Linux, AWS, Ansible, Jenkins, GIT, Terraform, CI, CD, Cloudformation, Typescript

As a DevOps Engineer, you are responsible for setting up and maintaining the GIT repository, DevOps tools like Jenkins, UCD, Docker, Kubernetes, Jfrog Artifactory, Cloud monitoring tools, and Cloud security.

• Set up, configure, and maintain GIT repos, Jenkins, UCD, etc. for multi-hosting cloud environments.
• Architect and maintain the server infrastructure in AWS. Build highly resilient infrastructure following industry best practices.
• Work on Docker images and maintain Kubernetes clusters.
• Develop and maintain the automation scripts using Ansible or other available tools.
• Maintain and monitor cloud Kubernetes Clusters and patching when necessary.
• Work on Cloud security tools to keep applications secured.
• Participate in software development lifecycle, specifically infra design, execution, and debugging required to achieve a successful implementation of integrated solutions within the portfolio.
• Have the necessary technical and professional expertise.

• Minimum 5-12 years of experience in the IT industry.
• Expertise in implementing and managing DevOps CI/CD pipeline.
• Experience in DevOps automation tools. Well versed with DevOps Frameworks, and Agile.
• Working knowledge of scripting using Shell, Python, Terraform, Ansible, Puppet, or chef.
• Experience and good understanding of any Cloud like AWS, Azure, or Google cloud.
• Knowledge of Docker and Kubernetes is required.
• Proficient in troubleshooting skills with proven abilities in resolving complex technical issues.
• Experience working with ticketing tools.
• Middleware technologies knowledge or database knowledge is desirable.
• Experience with Jira is a plus.

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality of content, interact, and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being here.

It  is a rapidly growing fintech SaaS firm that propels business growth while focusing on human motivation. Backed by Giift and Apis Partners Growth Fund II,offers a suite of three products - Plum, Empuls, and Compass. Works with more than 2000 clients across 10+ countries and over 2.5 million users. Headquartered in Bengaluru, It  is a 300+ strong team with four global offices in San Francisco, Dublin, Singapore, New Delhi.

We look forward to connecting with you. As you may take time to review this opportunity, we will wait for a reasonable time of around 3-5 days before we screen the collected applications and start lining up job discussions with the hiring manager. We however assure you that we will attempt to maintain a reasonable time window for successfully closing this requirement. The candidates will be kept informed and updated on the feedback and application status.

Roles & Responsibilities :

• Champion engineering and operational excellence.
• Establish a solid infrastructure framework and excellent development and deployment processes.
• Provide technical guidance to both your team members and your peers from the development team.
• Work with the development teams closely to gather system requirements, new service proposals and large system improvements and come up with the infrastructure architecture leading to stable, well-monitored fly, performant and secure systems.
• Be part of and help create a positive work environment based on accountability.
• Communicate across functions and drive engineering initiatives.
• Initiate cross team collaboration with product development teams to develop high quality, polished products, and services.

Required Skills :

• 5+ years of professional experience developing and launching software products on Cloud.
• Basic understanding Java/Go Programming
• Good Understanding of Container Technologies/Orchestration platforms (e. g Docker, Kubernetes)
• Deep understanding of AWS or Any Cloud.
• Good understanding of data stores like Postgres, Redis, Kafka, and Elasticsearch.
• Good Understanding of Operating systems
• Strong technical background with track record of individual technical accomplishments
• Ability to handle multiple competing priorities in a fast-paced environment
• Ability to establish credibility with smart engineers quickly.
• Most importantly, ability to learn and urge to learn new things.
• B.Tech/M.Tech in Computer Science or a related technical field.

• Proficient in Linux Commands line and troubleshooting.
• Proficient in AWS Services. Deployment, Monitoring and troubleshooting applications in AWS.
• Hands-on experience with CI tooling preferably with Jenkins.
• Proficient in deployment using Ansible.
• Knowledge of infrastructure management tools (Infrastructure as cloud) such as terraform, AWS cloudformation etc.
• Proficient in deployment of applications behind load balancers and proxy servers such as nginx, apache.
• Scripting languages: Bash, Python, Groovy.
• Experience with Logging, Monitoring, and Alerting tools like ELK(Elastic-search, Logstash, Kibana), Nagios. Graylog, splunk Prometheus, Grafana is a plus.

Role : SRE

Experience : 4 - 8 Years

• Experience in building, deploying and operating cloud solutions on Kubernetes
• Strong expertise administrating and scaling Kubernetes on bare metal and CKA preferred
• Expertise on K8s Interfaces CNI, CSI, CRI and Service meshe
• Hands-on experience as a DevOps or Automation development
• Demonstrable knowledge of TCP/IP, Linux operating system internals, filesystems, disk/storage technologies and storage protocols.
• Experience working with Helm Charts and building out Infrastructure As Code (IaC)
• Experience in writing software to automate orchestration tasks at scale; we commonly use Python, Go, and Shell scripting
• Knowledge of systems (Linux, GNU tooling), networking (OSI model, DNS, routing) and virtualization vs containerization
• Expertise in CI/CD tooling for cloud-based applications specifically Terraform / CloudFormation, Jenkins and Git
• Architected CNF Orchestration with Kubernetes
• Strong understanding of the principles of 12-factor apps and modern containerized microservices
• Plan for reliability by designing systems to work across our multi-region and multi-cloud environments
• Experience developing and using Application & Integration stacks/tools such as Kafka, Spring Cloud, Apache Camel, Kubernetes, Docker, Redis, Knative, and NoSQL

• Expertise in Infrastructure & Application design & architecture
• Expertise in AWS, OS & networking
• Having good exposure on Infra & Application security
• Expertise in Python, Shell scripting
• Proficient with Devops tools Terraform, Jenkins, Ansible, Docker, GIT
• Solid background in systems engineering and operations
• Strong in Devops methodologies and processes
• Strong in CI/CD pipeline & SDLC.