Junior ELK Data Engineer

Overview

adesso India specialises in optimization of core business processes for organizations. Our focus is on providing state-of-the-art solutions that streamline operations and elevate productivity to new heights.

Comprised of a team of industry experts and experienced technology professionals, we ensure that our software development and implementations are reliable, robust, and seamlessly integrated with the latest technologies. By leveraging our extensive knowledge and skills, we empower businesses to achieve their objectives efficiently and effectively.

Job Description

The client’s department DPS, Digital People Solutions, offers a sophisticated portfolio of IT applications, providing a strong foundation for professional and efficient People & Organization (P&O) and Business Management, both globally and locally, for a well-known German company listed on the DAX-40 index, which includes the 40 largest and most liquid companies on the Frankfurt Stock Exchange

We are seeking talented DevOps-Engineers with focus on Elastic Stack (ELK) to join our dynamic DPS team. In this role, you will be responsible for refining and advising on the further development of an existing monitoring solution based on the Elastic Stack (ELK). You will independently handle tasks related to architecture, setup, technical migration, and documentation.

The current application landscape features multiple Java web services running on JEE application servers, primarily hosted on AWS, and integrated with various systems such as SAP, other services, and external partners. DPS is committed to delivering the best digital work experience for the customers employees and customers alike.

Responsibilities:

Install, set up, and automate rollouts using Ansible/CloudFormation for all stages (Dev, QA, Prod) in the AWS Cloud for components such as Elastic Search, Kibana, Metric beats, APM server, APM agents, and interface configuration.

Create and develop regular "Default Dashboards" for visualizing metrics from various sources like Apache Webserver, application servers and databases.

Improve and fix bugs in installation and automation routines.

Monitor CPU usage, security findings, and AWS alerts.

Develop and extend "Default Alerting" for issues like OOM errors, datasource issues, and LDAP errors.

Monitor storage space and create concepts for expanding the Elastic landscape in AWS Cloud and Elastic Cloud Enterprise (ECE).

Implement machine learning, uptime monitoring including SLA, JIRA integration, security analysis, anomaly detection, and other useful ELK Stack features.

Integrate data from AWS CloudWatch.

Document all relevant information and train involved personnel in the used technologies.

Requirements:

Experience with Elastic Stack (ELK) components and related technologies.

Proficiency in automation tools like Ansible and CloudFormation.

Strong knowledge of AWS Cloud services.

Experience in creating and managing dashboards and alerts.

Familiarity with IAM roles and rights management.

Ability to document processes and train team members.

Excellent problem-solving skills and attention to detail.

Skills & Requirements

Elastic Stack (ELK), Elasticsearch, Kibana, Logstash, Beats, APM, Ansible, CloudFormation, AWS Cloud, AWS CloudWatch, IAM roles, AWS security, Automation, Monitoring, Dashboard creation, Alerting, Anomaly detection, Machine learning integration, Uptime monitoring, JIRA integration, Apache Webserver, JEE application servers, SAP integration, Database monitoring, Troubleshooting, Performance optimization, Documentation, Training, Problem-solving, Security analysis.

Interested candidates are requested to email their resumes with the subject line "Application for [Job Title]".

Only applications received via email will be reviewed. Applications through other channels will not be considered.

Job Description

The client’s department DPS, Digital People Solutions, offers a sophisticated portfolio of IT applications, providing a strong foundation for professional and efficient People & Organization (P&O) and Business Management, both globally and locally, for a well-known German company listed on the DAX-40 index, which includes the 40 largest and most liquid companies on the Frankfurt Stock Exchange

We are seeking talented DevOps-Engineers with focus on Elastic Stack (ELK) to join our dynamic DPS team. In this role, you will be responsible for refining and advising on the further development of an existing monitoring solution based on the Elastic Stack (ELK). You will independently handle tasks related to architecture, setup, technical migration, and documentation.

The current application landscape features multiple Java web services running on JEE application servers, primarily hosted on AWS, and integrated with various systems such as SAP, other services, and external partners. DPS is committed to delivering the best digital work experience for the customers employees and customers alike.

Responsibilities:

Install, set up, and automate rollouts using Ansible/CloudFormation for all stages (Dev, QA, Prod) in the AWS Cloud for components such as Elastic Search, Kibana, Metric beats, APM server, APM agents, and interface configuration.

Create and develop regular "Default Dashboards" for visualizing metrics from various sources like Apache Webserver, application servers and databases.

Improve and fix bugs in installation and automation routines.

Monitor CPU usage, security findings, and AWS alerts.

Develop and extend "Default Alerting" for issues like OOM errors, datasource issues, and LDAP errors.

Monitor storage space and create concepts for expanding the Elastic landscape in AWS Cloud and Elastic Cloud Enterprise (ECE).

Implement machine learning, uptime monitoring including SLA, JIRA integration, security analysis, anomaly detection, and other useful ELK Stack features.

Integrate data from AWS CloudWatch.

Document all relevant information and train involved personnel in the used technologies.

Requirements:

Experience with Elastic Stack (ELK) components and related technologies.

Proficiency in automation tools like Ansible and CloudFormation.

Strong knowledge of AWS Cloud services.

Experience in creating and managing dashboards and alerts.

Familiarity with IAM roles and rights management.

Ability to document processes and train team members.

Excellent problem-solving skills and attention to detail.

Skills & Requirements

Elastic Stack (ELK), Elasticsearch, Kibana, Logstash, Beats, APM, Ansible, CloudFormation, AWS Cloud, AWS CloudWatch, IAM roles, AWS security, Automation, Monitoring, Dashboard creation, Alerting, Anomaly detection, Machine learning integration, Uptime monitoring, JIRA integration, Apache Webserver, JEE application servers, SAP integration, Database monitoring, Troubleshooting, Performance optimization, Documentation, Training, Problem-solving, Security analysis.

Job Overview:

You will work in engineering and development teams to integrate and develop cloud solutions and virtualized deployment of software as a service product. This will require understanding the software system architecture function as well as performance and security requirements. The DevOps Engineer is also expected to have expertise in available cloud solutions and services, administration of virtual machine clusters, performance tuning and configuration of cloud computing resources, the configuration of security, scripting and automation of monitoring functions. This position requires the deployment and management of multiple virtual clusters and working with compliance organizations to support security audits. The design and selection of cloud computing solutions that are reliable, robust, extensible, and easy to migrate are also important.

Experience:

• Experience working on billing and budgets for a GCP project - MUST
• Experience working on optimizations on GCP based on vendor recommendations - NICE TO HAVE
• Experience in implementing the recommendations on GCP
• Architect Certifications on GCP - MUST
• Excellent communication skills (both verbal & written) - MUST
• Excellent documentation skills on processes and steps and instructions- MUST
• At least 2 years of experience on GCP.

Basic Qualifications:

• Bachelor’s/Master’s Degree in Engineering OR Equivalent.
• Extensive scripting or programming experience (Shell Script, Python).
• Extensive experience working with CI/CD (e.g. Jenkins).
• Extensive experience working with GCP, Azure, or Cloud Foundry.
• Experience working with databases (PostgreSQL, elastic search).
• Must have 2 years of minimum experience with GCP certification.

Benefits :

• Competitive salary.
• Work from anywhere.
• Learning and gaining experience rapidly.
• Reimbursement for basic working set up at home.
• Insurance (including top-up insurance for COVID).

Location :

Remote - work from anywhere.

Ideal joining preferences:
Immediate or 15 days

DESIRED SKILLS AND EXPERIENCE

 Strong analytical and problem-solving skills

 Ability to work independently, learn quickly and be proactive

 3-5 years overall and at least 1-2 years of hands-on experience in designing and managing DevOps Cloud infrastructure

 Experience must include a combination of:

o Experience working with configuration management tools – Ansible, Chef, Puppet, SaltStack (expertise in at least one tool is a must)

o Ability to write and maintain code in at least one scripting language (Python preferred)

o Practical knowledge of shell scripting

o Cloud knowledge – AWS, VMware vSphere o Good understanding and familiarity with Linux

o Networking knowledge – Firewalls, VPNs, Load Balancers

o Web/Application servers, Nginx, JVM environments

o Virtualization and containers - Xen, KVM, Qemu, Docker, Kubernetes, etc.

o Familiarity with logging systems - Logstash, Elasticsearch, Kibana

o Git, Jenkins, Jira

You will make an ideal candidate if you have: 

• Experience of building a range of Services in a Cloud Service provider

• Expert understanding of DevOps principles and Infrastructure as a Code concepts and techniques

• Strong understanding of CI/CD tools (Jenkins, Ansible, GitHub)

• Managed an infrastructure that involved 50+ hosts/network 

• 3+ years of Kubernetes experience & 5+ years of experience in Native services such as Compute (virtual machines), Containers (AKS), Databases, DevOps, Identity, Storage & Security

• Experience in engineering solutions on cloud foundation platform using Infrastructure As Code methods (eg. Terraform)

• Security and Compliance, e.g. IAM and cloud compliance/auditing/monitoring tools

• Customer/stakeholder focus. Ability to build strong relationships with Application teams, cross functional IT and global/local IT teams

• Good leadership and teamwork skills - Works collaboratively in an agile environment

• Operational effectiveness - delivers solutions that align to approved design patterns and security standards

• Excellent skills in at least one of following: Python, Ruby, Java, JavaScript, Go, Node.JS

• Experienced in full automation and configuration management

• A track record of constantly looking for ways to do things better and an excellent understanding of the mechanism necessary to successfully implement change

• Set and achieved challenging short, medium and long term goals which exceeded the standards in their field

• Excellent written and spoken communication skills; an ability to communicate with impact, ensuring complex information is articulated in a meaningful way to wide and varied audiences

• Built effective networks across business areas, developing relationships based on mutual trust and encouraging others to do the same

• A successful track record of delivering complex projects and/or programmes, utilizing appropriate techniques and tools to ensure and measure success

• A comprehensive understanding of risk management and proven experience of ensuring own/others' compliance with relevant regulatory processes

Essential Skills :

• Demonstrable Cloud service provider experience - infrastructure build and configurations of a variety of services including compute, devops, databases, storage & security

• Demonstrable experience of Linux administration and scripting preferably Red Hat

• Experience of working with Continuous Integration (CI), Continuous Delivery (CD) and continuous testing tools

• Experience working within an Agile environment

• Programming experience in one or more of the following languages: Python, Ruby, Java, JavaScript, Go, Node.JS

• Server administration (either Linux or Windows)

• Automation scripting (using scripting languages such as Terraform, Ansible etc.)

• Ability to quickly acquire new skills and tools

Required Skills :

• Linux & Windows Server Certification