Junior ELK Data Engineer

JOB DETAILS:

- Job Title: Senior Devops Engineer 2

- Industry: Ride-hailing

- Experience: 5-7 years

- Working Days: 5 days/week

- Work Mode: ONSITE

- Job Location: Bangalore

- CTC Range: Best in Industry

Required Skills: Cloud & Infrastructure Operations, Kubernetes & Container Orchestration, Monitoring, Reliability & Observability, Proficiency with Terraform, Ansible etc., Strong problem-solving skills with scripting (Python/Go/Shell)

Criteria:

1.   Candidate must be from a product-based or scalable app-based start-ups company with experience handling large-scale production traffic.

2.   Minimum 5 yrs of experience working as a DevOps/Infrastructure Consultant

3.   Own end-to-end infrastructure right from non-prod to prod environment including self-managed

4.   Candidate must have experience in database migration from scratch 

5.   Must have a firm hold on the container orchestration tool Kubernetes

6.   Must have expertise in configuration management tools like Ansible, Terraform, Chef / Puppet

7.   Understanding programming languages like GO/Python, and Java

8.   Working on databases like Mongo/Redis/Cassandra/Elasticsearch/Kafka.

9.   Working experience on Cloud platform - AWS

10. Candidate should have Minimum 1.5 years stability per organization, and a clear reason for relocation.

Description 

Job Summary:

As a DevOps Engineer at company, you will be working on building and operating infrastructure at scale, designing and implementing a variety of tools to enable product teams to build and deploy their services independently, improving observability across the board, and designing for security, resiliency, availability, and stability. If the prospect of ensuring system reliability at scale and exploring cutting-edge technology to solve problems, excites you, then this is your fit.

Job Responsibilities:

● Own end-to-end infrastructure right from non-prod to prod environment including self-managed DBs

● Codify our infrastructure

● Do what it takes to keep the uptime above 99.99%

● Understand the bigger picture and sail through the ambiguities

● Scale technology considering cost and observability and manage end-to-end processes

● Understand DevOps philosophy and evangelize the principles across the organization

● Strong communication and collaboration skills to break down the silos

Job Requirements:

● B.Tech. / B.E. degree in Computer Science or equivalent software engineering degree/experience

● Minimum 5 yrs of experience working as a DevOps/Infrastructure Consultant

● Must have a firm hold on the container orchestration tool Kubernetes

● Must have expertise in configuration management tools like Ansible, Terraform, Chef / Puppet

● Strong problem-solving skills, and ability to write scripts using any scripting language

● Understanding programming languages like GO/Python, and Java

● Comfortable working on databases like Mongo/Redis/Cassandra/Elasticsearch/Kafka.

What’s there for you?

Company’s team handles everything – infra, tooling, and self-manages a bunch of databases, such as

● 150+ microservices with event-driven architecture across different tech stacks Golang/ java/ node

● More than 100,000 Request per second on our edge gateways

● ~20,000 events per second on self-managed Kafka

● 100s of TB of data on self-managed databases

● 100s of real-time continuous deployment to production

● Self-managed infra supporting

● 100% OSS

Interested candidates are requested to email their resumes with the subject line "Application for [Job Title]".

Only applications received via email will be reviewed. Applications through other channels will not be considered.

Job Description

The client’s department DPS, Digital People Solutions, offers a sophisticated portfolio of IT applications, providing a strong foundation for professional and efficient People & Organization (P&O) and Business Management, both globally and locally, for a well-known German company listed on the DAX-40 index, which includes the 40 largest and most liquid companies on the Frankfurt Stock Exchange

We are seeking talented DevOps-Engineers with focus on Elastic Stack (ELK) to join our dynamic DPS team. In this role, you will be responsible for refining and advising on the further development of an existing monitoring solution based on the Elastic Stack (ELK). You will independently handle tasks related to architecture, setup, technical migration, and documentation.

The current application landscape features multiple Java web services running on JEE application servers, primarily hosted on AWS, and integrated with various systems such as SAP, other services, and external partners. DPS is committed to delivering the best digital work experience for the customers employees and customers alike.

Responsibilities:

Install, set up, and automate rollouts using Ansible/CloudFormation for all stages (Dev, QA, Prod) in the AWS Cloud for components such as Elastic Search, Kibana, Metric beats, APM server, APM agents, and interface configuration.

Create and develop regular "Default Dashboards" for visualizing metrics from various sources like Apache Webserver, application servers and databases.

Improve and fix bugs in installation and automation routines.

Monitor CPU usage, security findings, and AWS alerts.

Develop and extend "Default Alerting" for issues like OOM errors, datasource issues, and LDAP errors.

Monitor storage space and create concepts for expanding the Elastic landscape in AWS Cloud and Elastic Cloud Enterprise (ECE).

Implement machine learning, uptime monitoring including SLA, JIRA integration, security analysis, anomaly detection, and other useful ELK Stack features.

Integrate data from AWS CloudWatch.

Document all relevant information and train involved personnel in the used technologies.

Requirements:

Experience with Elastic Stack (ELK) components and related technologies.

Proficiency in automation tools like Ansible and CloudFormation.

Strong knowledge of AWS Cloud services.

Experience in creating and managing dashboards and alerts.

Familiarity with IAM roles and rights management.

Ability to document processes and train team members.

Excellent problem-solving skills and attention to detail.

Skills & Requirements

Elastic Stack (ELK), Elasticsearch, Kibana, Logstash, Beats, APM, Ansible, CloudFormation, AWS Cloud, AWS CloudWatch, IAM roles, AWS security, Automation, Monitoring, Dashboard creation, Alerting, Anomaly detection, Machine learning integration, Uptime monitoring, JIRA integration, Apache Webserver, JEE application servers, SAP integration, Database monitoring, Troubleshooting, Performance optimization, Documentation, Training, Problem-solving, Security analysis.

Job Overview:

You will work in engineering and development teams to integrate and develop cloud solutions and virtualized deployment of software as a service product. This will require understanding the software system architecture function as well as performance and security requirements. The DevOps Engineer is also expected to have expertise in available cloud solutions and services, administration of virtual machine clusters, performance tuning and configuration of cloud computing resources, the configuration of security, scripting and automation of monitoring functions. This position requires the deployment and management of multiple virtual clusters and working with compliance organizations to support security audits. The design and selection of cloud computing solutions that are reliable, robust, extensible, and easy to migrate are also important.

Experience:

• Experience working on billing and budgets for a GCP project - MUST
• Experience working on optimizations on GCP based on vendor recommendations - NICE TO HAVE
• Experience in implementing the recommendations on GCP
• Architect Certifications on GCP - MUST
• Excellent communication skills (both verbal & written) - MUST
• Excellent documentation skills on processes and steps and instructions- MUST
• At least 2 years of experience on GCP.

Basic Qualifications:

• Bachelor’s/Master’s Degree in Engineering OR Equivalent.
• Extensive scripting or programming experience (Shell Script, Python).
• Extensive experience working with CI/CD (e.g. Jenkins).
• Extensive experience working with GCP, Azure, or Cloud Foundry.
• Experience working with databases (PostgreSQL, elastic search).
• Must have 2 years of minimum experience with GCP certification.

Benefits :

• Competitive salary.
• Work from anywhere.
• Learning and gaining experience rapidly.
• Reimbursement for basic working set up at home.
• Insurance (including top-up insurance for COVID).

Location :

Remote - work from anywhere.

Ideal joining preferences:
Immediate or 15 days

POSITION SUMMARY:

We are looking for a passionate, high energy individual to help build and manage the infrastructure network that powers the Product Development Labs for F5 Inc. The F5 Infra Engineer plays a critical role to our Product Development team by providing valuable services and tools for the F5 Hyderabad Product Development Lab. The Infra team supports both production systems and customized/flexible testing environments used by Test and Product Development teams. As an Infra Engineer, you ’ll have the opportunity to work with cutting-edge technology and work with talented individuals. The ideal candidate will have experience in Private and Public Cloud – AWS-AZURE-GCP, OpenStack, storage, Backup, VMware, KVM, XEN, HYPER-V Hypervisor Server Administration, Networking and Automation in Data Center Operations environment at a global enterprise scale with Kubernetes, OpenShift Container Flatforms.

EXPERIENCE

7- 9+ Years – Software Engineer III

PRIMARY RESPONSIBILITIES:

• Drive the design, Project Build, Infrastructure setup, monitoring, measurements, and improvements around the quality of services Provided, Network and Virtual Instances service from OpenStack, VMware VIO, Public and private cloud and DevOps environments.

• Work closely with the customers and understand the requirements and get it done on timelines.

• Work closely with F5 architects and vendors to understand emerging technologies and F5 Product Roadmap and how they would benefit the Infra team and its users.

• Work closely with the Team and complete the deliverables on-time

• Consult with testers, application, and service owners to design scalable, supportable network infrastructure to meet usage requirements.

• Assume ownership for large/complex systems projects; mentor Lab Network Engineers in the best practices for ongoing maintenance and scaling of large/complex systems.

• Drive automation efforts for the configuration and maintainability of the public/private Cloud.  

• Lead product selection for replacement or new technologies

• Address user tickets in a timely manner for the covered services

• Responsible for deploying, managing, and supporting production and pre-production environments for our core systems and services.

• Migration and consolidations of infrastructure

• Design and implement major service and infrastructure components.

• Research, investigate and define new areas of technology to enhance existing service or new service directions.

• Evaluate performance of services and infrastructure; tune, re-evaluate the design and implementation of current source code and system configuration.

• Create and maintain scripts and tools to automate the configuration, usability and troubleshooting of the supported applications and services.

• Ability to take ownership on activities and new initiatives.

• Infra Global Support from India towards product Development teams.

• On-call support on a rotational basis for a global turn-around time-zones

• Vendor Management for all latest hardware and software evaluations keep the system up-to-date.

KNOWLEDGE, SKILLS AND ABILITIES:

• Have an in-depth multi-disciplined knowledge of Storage, Compute, Network, DevOps technologies and latest cutting-edge technologies.

• Multi-cloud - AWS, Azure, GCP, OpenStack, DevOps Operations

• IaaS- Infrastructure as a service, Metal as service, Platform service

• Storage – Dell EMC, NetApp, Hitachi, Qumulo and Other storage technologies

• Hypervisors – (VMware, Hyper-V, KVM, Xen and AHV)

• DevOps – Kubernetes, OpenShift, docker, other container and orchestration flatforms

• Automation – Scripting experience python/shell/golan , Full Stack development and Application Deployment

• Tools - Jenkins, splunk, kibana, Terraform, Bitbucket, Git, CI/CD configuration.

• Datacenter Operations – Racking, stacking, cable matrix, Solution Design and Solutions Architect 

• Networking Skills –   Cisco/Arista Switches, Routers, Experience on Cable matrix design and pathing (Fiber/copper)

• Experience in SAN/NAS storage – (EMC/Qumulo/NetApp & others)

• Experience with Red Hat Ceph storage.

• A working knowledge of Linux, Windows, and Hypervisor Operating Systems and virtual machine technologies

• SME - subject matter expert for all cutting-edge technologies

• Data center architect professional & Storage Expert level Certified professional experience .

• A solid understanding of high availability systems, redundant networking and multipathing solutions

• Proven problem resolution related to network infrastructure, judgment, negotiating and decision-making skills along with excellent written and oral communication skills.

• A Working experience in Object – Block – File storage Technologies

• Experience in Backup Technologies and backup administration.

• Dell/HP/Cisco UCS server’s administration is an additional advantage.

• Ability to quickly learn and adopt new technologies.

• A very very story experience and exposure towards open-source flatforms.

• A working experience on monitoring tools Zabbix, nagios , Datadog etc ..

• A working experience on and BareMetal services and OS administration.

• A working experience on the cloud like AWS- ipsec, Azure - express route, GCP – Vpn tunnel etc.

• A working experience in working using software define network like (VMware NSX, SDN, Openvswitch etc ..)

• A working experience with systems engineering and Linux /Unix administration

• A working experience with Database administration experience with PostgreSQL, MySQL, NoSQL

• A working experience with automation/configuration management using either Puppet, Chef or an equivalent

• A working experience with DevOps Operations Kubernetes, container, Docker, and git repositories

• Experience in Build system process and Code-inspect and delivery methodologies.

• Knowledge on creating Operational Dashboards and execution lane.

• Experience and knowledge on DNS, DHCP, LDAP, AD, Domain-controller services and PXE Services

• SRE experience in responsible for availability, latency, performance, efficiency, change management, monitoring, emergency response, and capacity planning.

• Vendor support – OEM upgrades, coordinating technical support and troubleshooting experience.

• Experience in handling On-call Support and hierarchy process.

• Knowledge on scale-out and scale-in architecture.

• Working experience in ITSM / process Management tools like ServiceNow, Jira, Jira Align.

• Knowledge on Agile and Scrum principles

• Working experience with ServiceNow

• Knowledge sharing, transition experience and self-learning Behavioral.

Title: Cloud DevOps Engineer 

Role: Individual Contributor (4-8 yrs)  

Requirements: 

• Energetic self-starter, a fast learner, with a desire to work in a startup environment  
• Experience working with Public Clouds like AWS 

• Operating and Monitoring cloud infrastructure on AWS. 
• Primary focus on building, implementing and managing operational support 
• Design, Develop and Troubleshoot Automation scripts (Configuration/Infrastructure as code or others) for Managing Infrastructure. 
• Expert at one of the scripting languages – Python, shell, etc  
• Experience with Nginx/HAProxy, ELK Stack, Ansible, Terraform, Prometheus-Grafana stack, etc 

• Handling load monitoring, capacity planning, and services monitoring. 
• Proven experience With CICD Pipelines and Handling Database Upgrade Related Issues. 
• Good Understanding and experience in working with Containerized environments like Kubernetes and Datastores like Cassandra, Elasticsearch, MongoDB, etc