Kubernetes Engineer

Job Title: DevOps SDE llI

Job Summary

Porter seeks an experienced cloud and DevOps engineer to join our infrastructure platform team. This team is responsible for the organization's cloud platform, CI/CD, and observability infrastructure. As part of this team, you will be responsible for providing a scalable, developer-friendly cloud environment by participating in the design, creation, and implementation of automated processes and architectures to achieve our vision of an ideal cloud platform.

Responsibilities and Duties

In this role, you will

• Own and operate our application stack and AWS infrastructure to orchestrate and manage our applications.
• Support our application teams using AWS by provisioning new infrastructure and contributing to the maintenance and enhancement of existing infrastructure.
• Build out and improve our observability infrastructure.
• Set up automated auditing processes and improve our applications' security posture.
• Participate in troubleshooting infrastructure issues and preparing root cause analysis reports.
• Develop and maintain our internal tooling and automation to manage the lifecycle of our applications, from provisioning to deployment, zero-downtime and canary updates, service discovery, container orchestration, and general operational health.
• Continuously improve our build pipelines, automated deployments, and automated testing.
• Propose, participate in, and document proof of concept projects to improve our infrastructure, security, and observability.

Qualifications and Skills

Hard requirements for this role:

• 5+ years of experience as a DevOps / Infrastructure engineer on AWS.
• Experience with git, CI / CD, and Docker. (We use GitHub, GitHub actions, Jenkins, ECS and Kubernetes).
• Experience in working with infrastructure as code (Terraform/CloudFormation).
• Linux and networking administration experience.
• Strong Linux Shell scripting experience.
• Experience with one programming language and cloud provider SDKs. (Python + boto3 is preferred)
• Experience with configuration management tools like Ansible and Packer.
• Experience with container orchestration tools. (Kubernetes/ECS).
• Database administration experience and the ability to write intermediate-level SQL queries. (We use Postgres)
• AWS SysOps administrator + Developer certification or equivalent knowledge

Good to have:

• Experience working with ELK stack.
• Experience supporting JVM applications.
• Experience working with APM tools is good to have. (We use datadog)
• Experience working in a XaaC environment. (Packer, Ansible/Chef, Terraform/Cloudformation, Helm/Kustomise, Open policy agent/Sentinel)
• Experience working with security tools. (AWS Security Hub/Inspector/GuardDuty)
• Experience with JIRA/Jira help desk.

MLOps Engineer

Required Candidate profile :

• 3+ years’ experience in developing continuous integration and deployment (CI/CD) pipelines (e.g. Jenkins, Github Actions) and bringing ML models to CI/CD pipelines
• Candidate with strong Azure expertise
• Exposure of Productionize the models
• Candidate should have complete knowledge of Azure ecosystem, especially in the area of DE
• Candidate should have prior experience in Design, build, test, and maintain machine learning infrastructure to empower data scientists to rapidly iterate on model development
• Develop continuous integration and deployment (CI/CD) pipelines on top of Azure that includes AzureML, MLflow and Azure Devops
• Proficient knowledge of git, Docker and containers, Kubernetes
• Familiarity with Terraform
• E2E production experience with Azure ML, Azure ML Pipelines
• Experience in Azure ML extension for Azure Devops
• Worked on Model Drift (Concept Drift, Data Drift preferable on Azure ML.)
• Candidate will be part of a cross-functional team that builds and delivers production-ready data science projects. You will work with team members and stakeholders to creatively identify, design, and implement solutions that reduce operational burden, increase reliability and resiliency, ensure disaster recovery and business continuity, enable CI/CD, optimize ML and AI services, and maintain it all in infrastructure as code everything-in-version-control manner.
• Candidate with strong Azure expertise
• Candidate should have complete knowledge of Azure ecosystem, especially in the area of DE
• Candidate should have prior experience in Design, build, test, and maintain machine learning infrastructure to empower data scientists to rapidly iterate on model development
• Develop continuous integration and deployment (CI/CD) pipelines on top of Azure that includes AzureML, MLflow and Azure Devops

A.P.T Portfolio, a high frequency trading firm that specialises in Quantitative Trading & Investment Strategies.Founded in November 2009, it has been a major liquidity provider in global Stock markets. 

As a manager, you would be incharge of managing the devops team and your remit shall include the following

• Private Cloud - Design & maintain a high performance and reliable network architecture to support  HPC applications
• Scheduling Tool - Implement and maintain a HPC scheduling technology like Kubernetes, Hadoop YARN  Mesos, HTCondor or Nomad for processing & scheduling analytical jobs. Implement controls which allow analytical jobs to seamlessly utilize ideal capacity on the private cloud. 
• Security - Implementing best security practices and implementing data isolation policy between different divisions internally. 
• Capacity Sizing - Monitor private cloud usage and share details with different teams. Plan capacity enhancements on a quarterly basis. 
• Storage solution - Optimize storage solutions like NetApp, EMC, Quobyte for analytical jobs. Monitor their performance on a daily basis to identify issues early.
• NFS - Implement and optimize latest version of NFS for our use case. 
• Public Cloud - Drive AWS/Google-Cloud utilization in the firm for increasing efficiency, improving collaboration and for reducing cost. Maintain the environment for our existing use cases. Further explore potential areas of using public cloud within the firm. 
• BackUps  - Identify and automate  back up of all crucial data/binary/code etc in a secured manner at such duration warranted by the use case. Ensure that recovery from back-up is tested and seamless. 
•  Access Control  - Maintain password less access control and improve security over time. Minimize failures for automated job due to unsuccessful logins. 
•  Operating System  -Plan, test and roll out new operating system for all production, simulation and desktop environments. Work closely with developers to highlight new performance enhancements capabilities of new versions. 
•  Configuration management  -Work closely with DevOps/ development team to freeze configurations/playbook for various teams & internal applications. Deploy and maintain standard tools such as Ansible, Puppet, chef etc for the same. 
•  Data Storage & Security Planning  - Maintain a tight control of root access on various devices. Ensure root access is rolled back as soon the desired objective is achieved.
• Audit access logs on devices. Use third party tools to put in a monitoring mechanism for early detection of any suspicious activity. 
• Maintaining all third party tools used for development and collaboration - This shall include maintaining a fault tolerant   environment for GIT/Perforce, productivity tools such as Slack/Microsoft team, build tools like Jenkins/Bamboo etc

Qualifications 

• Bachelors or Masters Level Degree, preferably in CSE/IT
• 10+ years of relevant experience in sys-admin function
• Must have strong knowledge of IT Infrastructure, Linux, Networking and grid.
• Must have strong grasp of automation & Data management tools.
• Efficient in scripting languages and python

Desirables

• Professional attitude, co-operative and mature approach to work, must be focused, structured and well considered, troubleshooting skills.
•  Exhibit a high level of individual initiative and ownership, effectively collaborate with other team members.

APT Portfolio is an equal opportunity employer

• Works independently without any supervision
• Work on continuous improvement of the products through innovation and learning. Someone with a knack for benchmarking and optimization
• Experience in deploying highly complex, distributed transaction processing systems.
• Stay abreast with new innovations and the latest technology trends and explore ways of leveraging these for improving the product in alignment with the business.
• As a component owner, where the component impacts across multiple platforms (5-10-member team), work with customers to obtain their requirements and deliver the end-to-end project.

Required Experience, Skills, and Qualifications

• 5+ years of experience as a DevOps Engineer. Experience with the Golang cycle is a plus
• At least one End to End CI/CD Implementation experience
• Excellent Problem Solving and Debugging skills in DevOps area· Good understanding of Containerization (Docker/Kubernetes)
• Hands-on Build/Package tool experience· Experience with AWS services Glue, Athena, Lambda, EC2, RDS, EKS/ECS, ALB, VPC, SSM, Route 53
• Experience with setting up CI/CD pipeline for Glue jobs, Athena, Lambda functions
• Experience architecting interaction with services and application deployments on AWS
• Experience with Groovy and writing Jenkinsfile
• Experience with repository management, code scanning/linting, secure scanning tools
• Experience with deployments and application configuration on Kubernetes
• Experience with microservice orchestration tools (e.g. Kubernetes, Openshift, HashiCorp Nomad)
• Experience with time-series and document databases (e.g. Elasticsearch, InfluxDB, Prometheus)
• Experience with message buses (e.g. Apache Kafka, NATS)
• Experience with key-value stores and service discovery mechanisms (e.g. Redis, HashiCorp Consul, etc)
  
  

• Provide consultation and review all outgoing critical customer communications.
• Apply DevOps thinking in bringing the development and IT Ops process, people, and tools together within the company in order to increase the speed, efficiency, and quality.
• Perform architecture and security reviews for different projects, work with leads to develop strategy and roadmap for the client requirements. Involve in designing of the overall architecture of the system with another leads/architect.
• Develop and grow engineers in DevOps technology to meet the incoming requirements from the business team.
• Work with senior technical team to bring in new technologies/tools being used within the company. Develop and promote best practices and emerging concepts for DevSecOps and secure CI/CD. Participate in Solution Strategy, innovation areas, and technology roadmap.

Key Skills:

• Deals positively with high levels of uncertainty, ambiguity, and shifting priorities.
• Ability to influence stakeholders as a trusted advisor across all levels, including teams outside of shared services.
• Ability to think outside of the box and be innovative by keeping abreast of new trends, identifying opportunities to bring in change for business benefit.
• Implementing CI (Continuous Integration) and CD (Continuous Deployment). Have Good exposure to CI & Build Management tools like Jenkins Azure DevOps GitHub Actions Maven Gradle and etc
• Deployment and provisioning tools (Chef/Ansible/Terraform/AWS CDK etc)
• Docker Orchestration tools like Kubernetes/Swarm etc
• Good hands-on knowledge of automation scripting Python Shell Ruby etc
• Version Control for Source Code Management (SCM) tool: GIT/Bitbucket and etc
• Expertise in Linux based systems like Unix Linux Ubuntu and also manage security systems Linux file system permission etc
• Container Orchestration tool: Kubernetes Swarm Meso Marathon Docker Writing Docker file Docker compose
• Expertise in managing Cloud resources and good exposure to Docker
• Public/Private/Hybrid cloud: AWS /Microsoft Azure/ Google Cloud Platform etc
• Extensive experience with cloud services elastic capacity administration and cloud deployment and migration.
• Good to have knowledge of tools like Splunk, New Relic, PagerDuty, VictorOps
• Familiarity with Network protocols and elements - TCP/IP HTTP(S) SSL DNS Firewall router load balancers proxy.
• Excellent in creating new and improve existing workflows within the agile software development lifecycle.
• Familiar with incident and change management processes.
• Ability to effectively priorities work with fast-changing requirements.
• Troubleshoot and debug infrastructure Network and operating system issues.
• Resolve complex issues in scenarios like resource consumptions server performance backup strategy Scaling.
• Investigate and perform Root Cause Analysis on users' reported issues and provide a workaround before implementing a final fix.
• Monitor servers and applications to ensure the smooth running of IT Architecture (Applications Services Schedulers Server Performance etc)

Design Skills:

• Interpret and implement the designs of others adhering to standards and guidelines
• Design solutions within their area of expertise using technologies that already exist within Tesco
• Understand the roadmaps for their area of Technology Design secure solutions
• Design solutions that can be consumed in a self-service manner by the engineering teams
• Understand the impact of technologies at an enterprise-scale innovation
• Demonstrate knowledge of the latest technology trends related to Infrastructure
• Understand how Industry trends impact their own area
• identify opportunities to automate work and deliver against them

• Azure Devops - Working experience in Azure yaml pipelines. (Note – Some say they worked in yaml but it’s for Jenkins and not Azure devops)
• Azure – Infrastructure automation using Terraform/ARM templates. (Note – Some say that they worked in terraform but it’s for AWS and not Azure). Please confirm Terraform for Azure infrastructure automation.
• Powershell scripting to automate and deploy .Net applications.