Data Engineer

Roles and Responsibilities:

• AWS Cloud Management: Design, deploy, and manage AWS cloud infrastructure. Optimize and maintain cloud resources for performance and cost efficiency. Monitor and ensure the security of cloud-based systems.
• Automated Provisioning: Develop and implement automated provisioning processes for infrastructure deployment. Utilize tools like Terraform and Packer to automate and streamline the provisioning of resources.
• Infrastructure as Code (IaC): Champion the use of Infrastructure as Code principles. Collaborate with development and operations teams to define and maintain IaC scripts for infrastructure deployment and configuration.
• Collaboration and Communication: Work closely with cross-functional teams to understand project requirements and provide DevOps expertise. Communicate effectively with team members and stakeholders regarding infrastructure changes, updates, and improvements.
• Continuous Integration/Continuous Deployment (CI/CD): Implement and maintain CI/CD pipelines to automate software delivery processes. Ensure reliable and efficient deployment of applications through the development lifecycle.
• Performance Monitoring and Optimization: Implement monitoring solutions to track system performance, troubleshoot issues, and optimize resource utilization. Proactively identify opportunities for system and process improvements. 

Mandatory Skills:

• Proven experience as a DevOps Engineer or similar role, with a focus on AWS.
• Strong proficiency in automated provisioning and cloud management.
• Experience with Infrastructure as Code tools, particularly Terraform and Packer.
• Solid understanding of CI/CD pipelines and version control systems.
• Strong scripting skills (e.g., Python, Bash) for automation tasks.
• Excellent problem-solving and troubleshooting skills.
• Good interpersonal and communication skills for effective collaboration.

Secondary Skills:

• AWS certifications (e.g., AWS Certified DevOps Engineer, AWS Certified Solutions Architect).
• Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Knowledge of microservices architecture and serverless computing.
• Familiarity with monitoring and logging tools (e.g., CloudWatch, ELK stack).

Interested candidates are requested to email their resumes with the subject line "Application for [Job Title]".

Only applications received via email will be reviewed. Applications through other channels will not be considered.

Job Description

The client’s department DPS, Digital People Solutions, offers a sophisticated portfolio of IT applications, providing a strong foundation for professional and efficient People & Organization (P&O) and Business Management, both globally and locally, for a well-known German company listed on the DAX-40 index, which includes the 40 largest and most liquid companies on the Frankfurt Stock Exchange

We are seeking talented DevOps-Engineers with focus on Elastic Stack (ELK) to join our dynamic DPS team. In this role, you will be responsible for refining and advising on the further development of an existing monitoring solution based on the Elastic Stack (ELK). You will independently handle tasks related to architecture, setup, technical migration, and documentation.

The current application landscape features multiple Java web services running on JEE application servers, primarily hosted on AWS, and integrated with various systems such as SAP, other services, and external partners. DPS is committed to delivering the best digital work experience for the customers employees and customers alike.

Responsibilities:

Install, set up, and automate rollouts using Ansible/CloudFormation for all stages (Dev, QA, Prod) in the AWS Cloud for components such as Elastic Search, Kibana, Metric beats, APM server, APM agents, and interface configuration.

Create and develop regular "Default Dashboards" for visualizing metrics from various sources like Apache Webserver, application servers and databases.

Improve and fix bugs in installation and automation routines.

Monitor CPU usage, security findings, and AWS alerts.

Develop and extend "Default Alerting" for issues like OOM errors, datasource issues, and LDAP errors.

Monitor storage space and create concepts for expanding the Elastic landscape in AWS Cloud and Elastic Cloud Enterprise (ECE).

Implement machine learning, uptime monitoring including SLA, JIRA integration, security analysis, anomaly detection, and other useful ELK Stack features.

Integrate data from AWS CloudWatch.

Document all relevant information and train involved personnel in the used technologies.

Requirements:

Experience with Elastic Stack (ELK) components and related technologies.

Proficiency in automation tools like Ansible and CloudFormation.

Strong knowledge of AWS Cloud services.

Experience in creating and managing dashboards and alerts.

Familiarity with IAM roles and rights management.

Ability to document processes and train team members.

Excellent problem-solving skills and attention to detail.

Skills & Requirements

Elastic Stack (ELK), Elasticsearch, Kibana, Logstash, Beats, APM, Ansible, CloudFormation, AWS Cloud, AWS CloudWatch, IAM roles, AWS security, Automation, Monitoring, Dashboard creation, Alerting, Anomaly detection, Machine learning integration, Uptime monitoring, JIRA integration, Apache Webserver, JEE application servers, SAP integration, Database monitoring, Troubleshooting, Performance optimization, Documentation, Training, Problem-solving, Security analysis.

• Hands on experience in AWS provisioning of AWS services like EC2, S3,EBS, AMI, VPC, ELB, RDS, Auto scaling groups, Cloud Formation.
• Good experience on Build and release process and extensively involved in the CICD using

Jenkins

• Experienced on configuration management tools like Ansible.
• Designing, implementing and supporting fully automated Jenkins CI/CD
• Extensively worked on Jenkins for continuous Integration and for end to end Automation for all Builds and Deployments.
• Proficient with Docker based container deployments to create shelf environments for dev teams and containerization of environment delivery for releases.
• Experience working on Docker hub, creating Docker images and handling multiple images primarily for middleware installations and domain configuration.
• Good knowledge in version control system in Git and GitHub.
• Good experience in build tools
• Implemented CI/CD pipeline using Jenkins, Ansible, Docker, Kubernetes ,YAML and Manifest

Hands on Experience with Linux administration

Experience using Python or Shell scripting (for Automation) 

Hands-on experience with Implementation of CI/CD Processes 

Experience working  with one cloud platforms (AWS or Azure or Google) 

Experience working with configuration management tools such as Ansible & Chef 

Experience working with  Containerization tool Docker.

Experience working with Container Orchestration tool Kubernetes.

Experience in source Control Management including SVN and/or Bitbucket

& GitHub

Experience with setup & management of monitoring tools like Nagios, Sensu & Prometheus or any other popular tools 

Hands-on experience in Linux, Scripting Language & AWS is mandatory

Troubleshoot and Triage development, Production issues

Role – Devops

Experience 3 – 6 Years

Roles & Responsibilities –

• 3-6 years of experience in deploying and managing highly scalable fault resilient systems
• Strong experience in container orchestration and server automation tools such as Kubernetes, Google Container Engine, Docker Swarm, Ansible, Terraform  

• Strong experience with Linux-based infrastructures, Linux/Unix administration, AWS, Google Cloud, Azure

• Strong experience with databases such as  MySQL, Hadoop, Elasticsearch, Redis, Cassandra, and MongoDB.

• Knowledge of scripting languages such as Java, JavaScript, Python, PHP, Groovy, Bash.

• Experience in configuring CI/CD pipelines using Jenkins, GitLab CI, Travis.
• Proficient in technologies such as Docker, Kafka, Raft and Vagrant

• Experience in implementing queueing services such as RabbitMQ, Beanstalkd, Amazon SQS and knowledge in ElasticStack is a plus.

Role : SRE

Experience : 4 - 8 Years

• Experience in building, deploying and operating cloud solutions on Kubernetes
• Strong expertise administrating and scaling Kubernetes on bare metal and CKA preferred
• Expertise on K8s Interfaces CNI, CSI, CRI and Service meshe
• Hands-on experience as a DevOps or Automation development
• Demonstrable knowledge of TCP/IP, Linux operating system internals, filesystems, disk/storage technologies and storage protocols.
• Experience working with Helm Charts and building out Infrastructure As Code (IaC)
• Experience in writing software to automate orchestration tasks at scale; we commonly use Python, Go, and Shell scripting
• Knowledge of systems (Linux, GNU tooling), networking (OSI model, DNS, routing) and virtualization vs containerization
• Expertise in CI/CD tooling for cloud-based applications specifically Terraform / CloudFormation, Jenkins and Git
• Architected CNF Orchestration with Kubernetes
• Strong understanding of the principles of 12-factor apps and modern containerized microservices
• Plan for reliability by designing systems to work across our multi-region and multi-cloud environments
• Experience developing and using Application & Integration stacks/tools such as Kafka, Spring Cloud, Apache Camel, Kubernetes, Docker, Redis, Knative, and NoSQL

• 7-10 years experience with secure SDLC/DevSecOps practices such as automating security processes within CI/CD pipeline.
• At least 4 yrs. experience designing, and securing Data Lake & Web applications deployed to AWS, Azure, Scripting/Automation skills on Python, Shell, YAML, JSON
• At least 4 years of hands-on experience with software development lifecycle, Agile project management (e.g. Jira, Confluence), source code management (e.g. Git), build automation (e.g. Jenkins), code linting and code quality (e.g. SonarQube), test automation (e.g. Selenium)
• Hand-on & Solid understanding of Amazon Web Services & Azure-based Infra & applications
• Experience writing cloud formation templates, Jenkins, Kubernetes, Docker, and microservice application architecture and deployment.
• Strong know-how on VA/PT integration in CI/CD pipeline.
• Experience in handling financial solutions & customer-facing applications

Roles

• Accelerate enterprise cloud adoption while enabling rapid and stable delivery of capabilities using continuous integration and continuous deployment principles, methodologies, and technologies
• Manage & deliver diverse cloud [AWS, Azure, GCP] DevSecOps journeys
• Identify, prototype, engineer, and deploy emerging software engineering methodologies and tools
• Maximize automation and enhance DevSecOps pipelines and other tasks
• Define and promote enterprise software engineering and DevSecOps standards, practices, and behaviors
• Operate and support a suite of enterprise DevSecOps services
• Implement security automation to decrease the loop between the development and deployment processes.
• Support project teams to adopt & integrate the DevSecOps environment
• Managing application vulnerabilities, Data security, encryption, tokenization, access management, Secure SDLC, SAST/DAST
• Coordinate with development and operations teams for practical automation solutions and custom flows.
• Own DevSecOps initiatives by providing objective, practical and relevant ideas, insights, and advice.
• Act as Release gatekeeper with an understanding of OWASP top 10 lists of vulnerabilities, NIST SP-800-xx, NVD, CVSS scoring, etc concepts
• Build workflows to ensure a successful DevSecOps journey for various enterprise applications. 
• Understand the strategic direction to reach business goals across multiple projects & teams
• Collaborate with development teams to understand project deliverables and promote DevSecOps culture
• Formulate & deploy cloud automation strategies and tools

Skills

• Knowledge of the DevSecOps culture and principles.
• An understanding of cloud technologies & components
• A flair for programming languages such as Shell, Python, Java Scripts,
• Strong teamwork and communication skills.
• Knowledge of threat modeling and risk assessment techniques.
• Up-to-date knowledge of cybersecurity threats, current best practices, and the latest software.
• An understanding of programs such as Puppet, Chef, ThreatModeler, Checkmarx, Immunio, and Aqua.
• Strong know-how of Kubernetes, Docker, AWS, Azure-based deployments
• On the job learning for new programming languages, automation tools, deployment architectures

• Automate deployments of infrastructure components and repetitive tasks.
• Drive changes strictly via the infrastructure-as-code methodology.
• Promote the use of source control for all changes including application and system-level changes.
• Design & Implement self-recovering systems after failure events.
• Participate in system sizing and capacity planning of various components.
• Create and maintain technical documents such as installation/upgrade MOPs.
• Coordinate & collaborate with internal teams to facilitate installation & upgrades of systems.
• Support 24x7 availability for corporate sites & tools.
• Participate in rotating on-call schedules.
• Actively involved in researching, evaluating & selecting new tools & technologies.

• Cloud computing – AWS, OCI, OpenStack
• Automation/Configuration management tools such as Terraform & Chef
• Atlassian tools administration (JIRA, Confluence, Bamboo, Bitbucket)
• Scripting languages - Ruby, Python, Bash
• Systems administration experience – Linux (Redhat), Mac, Windows
• SCM systems - Git
• Build tools - Maven, Gradle, Ant, Make
• Networking concepts - TCP/IP, Load balancing, Firewall
• High-Availability, Redundancy & Failover concepts
• SQL scripting & queries - DML, DDL, stored procedures
• Decisive and ability to work under pressure
• Prioritizing workload and multi-tasking ability
• Excellent written and verbal communication skills

• Database systems – Postgres, Oracle, or other RDBMS
• Mac automation tools - JAMF or other
• Atlassian Datacenter products
• Project management skills

• 3+ years of hands-on experience in the field or related area
• Requires MS or BS in Computer Science or equivalent field

• 2+ years of demonstrable experience leading site reliability and performance in large-scale, high-traffic environments
• 2+ years of hands-on experience as a DevOps engineer
• Strong leadership, communication and interpersonal skills geared to getting things done
• Developing themselves and the talent within their charge – fostering and creating opportunity for the team
• Strong understanding of SRE concepts and the DevOps culture. Set the direction and strategy for your team, and help shape the overall SRE program for the company
• Be able to lead complicated technical issues and communicating status updates/RCA with management and customers.
• Own site stability, performance, capacity planning, DevOps recruitment.