DevOps Engineer

Key Responsibilities:

● Set up a production-grade Apache Kafka in Kubernetes with Jenkins integration.

● Design a Jenkins-based CI/CD pipeline for multiple components, including Kafka Connect.

● Implement Horizontal Pod Autoscaler (HPA) for our 30-40 micro components.

● Configure comprehensive logging and monitoring, setting up Grafana dashboards with

Prometheus integration.

Key Requirements:

Must-Have Skills:

● Deep expertise in Git, Jenkins, Kubernetes, Helm, Docker, Kafka, Kafka Connect, Maven, Java,

Prometheus, Grafana, EKS/AKS, Load Balancer, and Ingress.

● Experience working with AWS and Azure cloud environments.

● 5+ years of relevant work experience.

Nice to Have:

● Familiarity with managing On-prem Kubernetes is a plus.

● Familiarity with Secret Manager, NodeJs, Python, Confluent Kafka, MongoDB, ElasticSearch,

FluentBit, FluentD, Aerospike, HBase, and MySQL.

● If you’re passionate about orchestrating large-scale system migrations and love to stay on the

bleeding edge of technology, then you’re just the professional we’re looking for.

About Company:

• Role Overview

• Senior Engineer with a strong background and experience in cloud related technologies and architectures. Can design target cloud architectures to transform existing architectures together with the in-house team. Can actively hands-on configure and build cloud architectures and guide others.

• Key Knowledge

• 3-5+ years of experience in AWS/GCP or Azure technologies
• Is likely certified on one or more of the major cloud platforms
• Strong experience from hands-on work with technologies such as Terraform, K8S, Docker and orchestration of containers.
• Ability to guide and lead internal agile teams on cloud technology
• Background from the financial services industry or similar critical operational experience

You will be responsible for:

• Managing all DevOps and infrastructure for Sizzle
• We have both cloud and on-premise servers
• Work closely with all AI and backend engineers on processing requirements and managing both development and production requirements
• Optimize the pipeline to ensure ultra fast processing
• Work closely with management team on infrastructure upgrades

You should have the following qualities:

• 3+ years of experience in DevOps, and CI/CD
• Deep experience in: Gitlab, Gitops, Ansible, Docker, Grafana, Prometheus
• Strong background in Linux system administration
• Deep expertise with AI/ML pipeline processing, especially with GPU processing. This doesn’t need to include model training, data gathering, etc. We’re looking more for experience on model deployment, and inferencing tasks at scale
• Deep expertise in Python including multiprocessing / multithreaded applications
• Performance profiling including memory, CPU, GPU profiling
• Error handling and building robust scripts that will be expected to run for weeks to months at a time
• Deploying to production servers and monitoring and maintaining the scripts
• DB integration including pymongo and sqlalchemy (we have MongoDB and PostgreSQL databases on our backend)
• Expertise in Docker-based virtualization including - creating & maintaining custom Docker images, deployment of Docker images on cloud and on-premise services, monitoring of production Docker images with robust error handling
• Expertise in AWS infrastructure, networking, availability

Optional but beneficial to have:

• Experience with running Nvidia GPU / CUDA-based tasks
• Experience with image processing in python (e.g. openCV, Pillow, etc)
• Experience with PostgreSQL and MongoDB (Or SQL familiarity)
• Excited about working in a fast-changing startup environment
• Willingness to learn rapidly on the job, try different things, and deliver results
• Bachelors or Masters degree in computer science or related field
• Ideally a gamer or someone interested in watching gaming content online

Skills:

DevOps, Ansible, CI/CD, GitLab, GitOps, Docker, Python, AWS, GCP, Grafana, Prometheus, python, sqlalchemy, Linux / Ubuntu system administration

Seniority: We are looking for a mid to senior level engineer

Salary: Will be commensurate with experience. 

Who Should Apply:

If you have the right experience, regardless of your seniority, please apply.

Work Experience: 3 years to 6 years

Electrum is looking for an experienced and proficient DevOps Engineer. This role will provide you with an opportunity to explore what’s possible in a collaborative and innovative work environment. If your goal is to work with a team of talented professionals that is keenly focused on solving complex business problems and supporting product innovation with technology, you might be our new DevOps Engineer. With this position, you will be involved in building out systems for our rapidly expanding team, enabling the whole engineering group to operate more effectively and iterate at top speed in an open, collaborative environment. The ideal candidate will have a solid background in software engineering and a vivid experience in deploying product updates, identifying production issues, and implementing integrations. The ideal candidate has proven capabilities and experience in risk-taking, is willing to take up challenges, and is a strong believer in efficiency and innovation with exceptional communication and documentation skills.

YOU WILL:

• Plan for future infrastructure as well as maintain & optimize the existing infrastructure. 
• Conceptualize, architect, and build:
• 1. Automated deployment pipelines in a CI/CD environment like Jenkins;
• 2. Infrastructure using Docker, Kubernetes, and other serverless platforms; 
• 3. Secured network utilizing VPCs with inputs from the security team. 
• Work with developers & QA team to institute a policy of Continuous Integration with Automated testing Architect, build and manage dashboards to provide visibility into delivery, production application functional, and performance status.
• Work with developers to institute systems, policies, and workflows which allow for a rollback of deployments. 
• Triage release of applications/ Hotfixes to the production environment on a daily basis.
• Interface with developers and triage SQL queries that need to be executed in production environments.
• Maintain 24/7 on-call rotation to respond and support troubleshooting of issues in production.
• Assist the developers and on calls for other teams with a postmortem, follow up and review of issues affecting production availability.
• Scale Electum platform to handle millions of requests concurrently.
• Reduce Mean Time To Recovery (MTTR), enable High Availability and Disaster Recovery

PREREQUISITES:

• Bachelor’s degree in engineering, computer science, or related field, or equivalent work experience.
• Minimum of six years of hands-on experience in software development and DevOps, specifically managing AWS Infrastructures such as EC2s, RDS, Elastic cache, S3, IAM, cloud trail, and other services provided by AWS.
• At least 2 years of experience in building and owning serverless infrastructure.
• At least 2 years of scripting experience in Python (Preferable) and Shell Web Application Deployment Systems Continuous Integration tools (Ansible).
• Experience building a multi-region highly available auto-scaling infrastructure that optimizes performance and cost.
• Experience in automating the provisioning of AWS infrastructure as well as automation of routine maintenance tasks.
• Must have prior experience automating deployments to production and lower environments.
• Worked on providing solutions for major automation with scripts or infrastructure.
• Experience with APM tools such as DataDog and log management tools.
• Experience in designing and implementing Essential Functions System Architecture Process; establishing and enforcing Network Security Policy (AWS VPC, Security Group) & ACLs.
• Experience establishing and enforcing:
• 1. System monitoring tools and standards
• 2. Risk Assessment policies and standards
• 3. Escalation policies and standards
• Excellent DevOps engineering, team management, and collaboration skills.
• Advanced knowledge of programming languages such as Python and writing code and scripts.
• Experience or knowledge in - Application Performance Monitoring (APM), and prior experience as an open-source contributor will be preferred.

We are looking for a Senior Platform Engineer responsible for handling our GCP/AWS clouds. The candidate will be responsible for automating the deployment of cloud infrastructure and services to support application development and hosting (architecting, engineering, deploying, and operationally managing the underlying logical and physical cloud computing infrastructure).

Job Description:

● Collaborate with teams to build and deliver solutions implementing serverless, microservice-based, IaaS, PaaS, and containerized architectures in GCP/AWS environments.

●Responsible for deploying highly complex, distributed transaction processing systems.

● Work on continuous improvement of the products through innovation and learning. Someone with a knack for benchmarking and optimization

● Hiring, developing, and cultivating a high and reliable cloud support team ● Building and operating complex CI/CD pipelines at scale

● Work with GCP Services, Private Service Connect, Cloud Run, Cloud Functions, Pub/Sub, Cloud Storage, Networking

● Collaborate with Product Management and Product Engineering teams to drive excellence in Google Cloud products and features.

● Ensures efficient data storage and processing functions by company security policies and best practices in cloud security.

● Ensuring scaled database setup/monitoring with near zero downtime

A.P.T Portfolio, a high frequency trading firm that specialises in Quantitative Trading & Investment Strategies.Founded in November 2009, it has been a major liquidity provider in global Stock markets. 

As a manager, you would be incharge of managing the devops team and your remit shall include the following

• Private Cloud - Design & maintain a high performance and reliable network architecture to support  HPC applications
• Scheduling Tool - Implement and maintain a HPC scheduling technology like Kubernetes, Hadoop YARN  Mesos, HTCondor or Nomad for processing & scheduling analytical jobs. Implement controls which allow analytical jobs to seamlessly utilize ideal capacity on the private cloud. 
• Security - Implementing best security practices and implementing data isolation policy between different divisions internally. 
• Capacity Sizing - Monitor private cloud usage and share details with different teams. Plan capacity enhancements on a quarterly basis. 
• Storage solution - Optimize storage solutions like NetApp, EMC, Quobyte for analytical jobs. Monitor their performance on a daily basis to identify issues early.
• NFS - Implement and optimize latest version of NFS for our use case. 
• Public Cloud - Drive AWS/Google-Cloud utilization in the firm for increasing efficiency, improving collaboration and for reducing cost. Maintain the environment for our existing use cases. Further explore potential areas of using public cloud within the firm. 
• BackUps  - Identify and automate  back up of all crucial data/binary/code etc in a secured manner at such duration warranted by the use case. Ensure that recovery from back-up is tested and seamless. 
•  Access Control  - Maintain password less access control and improve security over time. Minimize failures for automated job due to unsuccessful logins. 
•  Operating System  -Plan, test and roll out new operating system for all production, simulation and desktop environments. Work closely with developers to highlight new performance enhancements capabilities of new versions. 
•  Configuration management  -Work closely with DevOps/ development team to freeze configurations/playbook for various teams & internal applications. Deploy and maintain standard tools such as Ansible, Puppet, chef etc for the same. 
•  Data Storage & Security Planning  - Maintain a tight control of root access on various devices. Ensure root access is rolled back as soon the desired objective is achieved.
• Audit access logs on devices. Use third party tools to put in a monitoring mechanism for early detection of any suspicious activity. 
• Maintaining all third party tools used for development and collaboration - This shall include maintaining a fault tolerant   environment for GIT/Perforce, productivity tools such as Slack/Microsoft team, build tools like Jenkins/Bamboo etc

Qualifications 

• Bachelors or Masters Level Degree, preferably in CSE/IT
• 10+ years of relevant experience in sys-admin function
• Must have strong knowledge of IT Infrastructure, Linux, Networking and grid.
• Must have strong grasp of automation & Data management tools.
• Efficient in scripting languages and python

Desirables

• Professional attitude, co-operative and mature approach to work, must be focused, structured and well considered, troubleshooting skills.
•  Exhibit a high level of individual initiative and ownership, effectively collaborate with other team members.

APT Portfolio is an equal opportunity employer