Big Data Developer

Job Title: ELK Stack Engineer

Position Overview:

We are seeking a skilled and experienced Senior Elasticsearch Developer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining data pipelines using the ELK Stack (Elasticsearch 7.1 or higher, Logstash, Kibana). The Senior Elasticsearch Developer will play a key role in managing large datasets, optimizing complex queries, and maintaining self-hosted Elastic Search clusters.

Responsibilities:

• Design, develop, and maintain data pipelines using the ELK Stack.
• Handle large datasets (3 billion+ records, 100+ fields per index) with efficiency and accuracy.
• Develop and optimize complex Elasticsearch queries for efficient data retrieval and analysis.
• Manage and maintain self-hosted Elastic Search clusters.
• Implement DevOps practices, including containerization with Docker.
• Perform backups, disaster recovery, and index migrations to ensure data security and integrity.
• Execute data processing and cleaning techniques, including writing custom scripts to extract and transform data into usable formats.
• Collaborate with the engineering team to integrate Elastic Search with other systems.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or related field.
• Minimum 5+ years of experience in designing, developing, and maintaining data pipelines using the ELK Stack.
• Hands-on experience handling large datasets (3 million+ records, 50+ fields per index).
• Strong proficiency in developing and optimizing complex Elasticsearch queries.
• Experience managing and maintaining self-hosted ElasticSearch clusters.
• Proficiency in DevOps practices, including containerization with Docker.
• Knowledge of security best practices, including backups, disaster recovery, and index migrations.
• Experience with database administration and data processing techniques.
• Excellent communication and teamwork skills.

Benefits:

• Competitive salary and benefits package between 20 to 35 LPA.
• Opportunities for professional development and growth.
• Collaborative and inclusive work environment.
• Flexible work hours and remote work options.

Job Description

[Job Overview]:

● Perform role of MDG senior functional consultant SAP S/4 Hana ABAP skills will

also be good

● [Primary Skills]: SAP MDG domain in scope - Business Partner and Material

Expertise in any std master data domains like material, Business partner

Customer & supplier.

● Functional configuration of MDG like change request, BRF+ workflow

development, data model enhancements, MDGFPM config, etc Support domain

data replication process.

● Facilitate MDG data load and distribution. Understanding of the impact of the

enterprise on decisions made in MDG.

● Minimum 2 full lifecycle implementations in on Business partner Customer and

supplier and Material master domain.

● Hands-on experience in extending the data models, custom entities, and

attributes.

● Good to have knowledge of earlier versions of MDG and S/4 HANA Responsible

to interact with Business and to gather business requirements and accumulate

information.

● Good analytical skills, strong interpersonal and communication skills.

[Good to have Skills]:

JLPT N3 or N2 certified SAP S/4 Hana ABAP skills or debugging skills

[Responsibilities and Duties]:

● Actively engage with the client team by participating in the business process

discussions, understand the current processes, pain points and new

requirements to design an effective solution in S/4HANA.

● Lead the functional / technical consultants in ensuring successful delivery of the

SAP Solution and ensure deliverables for MDG are successfully handed over for

the closure of the project.

● Identify and escalate issues and risks within project structure as soon as

discovered and not just when the delivery is due

● Prepare Key user & End user training and workshop materials and conduct the

meetings Ensure documentation of all key project deliverables and execute

smooth transition plan to the Application maintenance team

● Support Effort Estimation, Solution Standardizing, conduct Training, Mentoring

and Coaching junior team members Strong client facing experience, Analytical

mind-set with a strong eagerness to learn and able to translate requirements into

designs and code / configuration

● Demonstrates excellent communication skills, both oral and written Open to work

in shifts and flexible to support during weekends / holidays in case of urgency

Key Skill :

- JavaScript with Dom Manipulation

- Good understanding on AJAX concepts

- Know jQuery implementation with its libraries

- Front-End Framework - Bootstrap knowledge

- In-Depth knowledge of PHP and its framework CodeIgniter

- In-Depth knowledge of Relational Database - MySQL

- Integration of Third Party Code Snippets.

- Knowledge of deployment the project on the production server

- Restful API Design and Development with CRUD Functionality

- Git/Github Knowledge

- Must be open to learn new technologies and frameworks as per the project's requirements

- Must have ability to work under pressure while performing priority tasks

- Must have critical and analytical skills

- Must be a quick and self-learner

Add on Benefits :

- Knowledge of Jira, Git and Digital Ocean are the key benefits.