11+ Apache Flume Jobs in Delhi, NCR and Gurgaon | Apache Flume Job openings in Delhi, NCR and Gurgaon

Hybrid work mode

(Azure) EDW Experience working in loading Star schema data warehouses using framework

architectures including experience loading type 2 dimensions. Ingesting data from various

sources (Structured and Semi Structured), hands on experience ingesting via APIs to lakehouse architectures.

Key Skills: Azure Databricks, Azure Data Factory, Azure Datalake Gen 2 Storage, SQL (expert),

Python (intermediate), Azure Cloud Services knowledge, data analysis (SQL), data warehousing,documentation – BRD, FRD, user story creation.

Job Title: Tech Lead and SSE – Kafka, Python, and Azure Databricks (Healthcare Data Project)

Experience: 4 to 12 years

Role Overview:

We are looking for a highly skilled Tech Lead with expertise in Kafka, Python, and Azure Databricks (preferred) to drive our healthcare data engineering projects. The ideal candidate will have deep experience in real-time data streaming, cloud-based data platforms, and large-scale data processing. This role requires strong technical leadership, problem-solving abilities, and the ability to collaborate with cross-functional teams.

Key Responsibilities:

• Lead the design, development, and implementation of real-time data pipelines using Kafka, Python, and Azure Databricks.
• Architect scalable data streaming and processing solutions to support healthcare data workflows.
• Develop, optimize, and maintain ETL/ELT pipelines for structured and unstructured healthcare data.
• Ensure data integrity, security, and compliance with healthcare regulations (HIPAA, HITRUST, etc.).
• Collaborate with data engineers, analysts, and business stakeholders to understand requirements and translate them into technical solutions.
• Troubleshoot and optimize Kafka streaming applications, Python scripts, and Databricks workflows.
• Mentor junior engineers, conduct code reviews, and ensure best practices in data engineering.
• Stay updated with the latest cloud technologies, big data frameworks, and industry trends.

Required Skills & Qualifications:

• 4+ years of experience in data engineering, with strong proficiency in Kafka and Python.
• Expertise in Kafka Streams, Kafka Connect, and Schema Registry for real-time data processing.
• Experience with Azure Databricks (or willingness to learn and adopt it quickly).
• Hands-on experience with cloud platforms (Azure preferred, AWS or GCP is a plus).
• Proficiency in SQL, NoSQL databases, and data modeling for big data processing.
• Knowledge of containerization (Docker, Kubernetes) and CI/CD pipelines for data applications.
• Experience working with healthcare data (EHR, claims, HL7, FHIR, etc.) is a plus.
• Strong analytical skills, problem-solving mindset, and ability to lead complex data projects.
• Excellent communication and stakeholder management skills.

What you need to have:

Desired Candidate Profile

• B.E/B.Tech and/or MBA
• Relevant experience of 7-10 years
• Understanding of customer needs and making appropriate proposals

SAP Basis / HANA 

• Solution Manager/FRUN Experience with detail knowledge of how SOLMAN system is integrated with Ticketing Tools. 
• Experience in Solution Manager Technical monitoring. 
• End to end monitoring for the sap system during the changes when the monitoring is not available or until the new one is in place 
• Manage the team to get the assigned task done on time adhering the SLA. 
• Align with different stakeholders to discuss the progress of multiple tasks. 
• SPOC of Alert management team. 
• Able to solve and coordinate RCA and support during critical system behaviour.
• Audit Experience. 
• Detailed Technical experience in SAP BASIS and HANA systems administrations. 
• Experience in setting up System Replications, High Availability and Disaster recovery. 
• Possess leadership qualities. 
• Proven track record of Client handling. 
• Knowledge of SAP HANA Enterprise Cloud is desirable. 
• Coach others recognize their strengths and encourage them to take ownership of their personal development. 
• Any Experience in SAP tools (SPC, LVM, etc.) will be advantage
• Ready to learn new technologies. 
• Should be ready to work in 24*7 shifts. 
• Any Experience ECS Managed Service Model would be added advantage

1. Motivate team to promote/sell professional courses like Data Science, Block chain, PMP, AI/ML, Six Sigma, SCRUM etc
2. Leaders who have catered in U.S, Canada, Malaysia, Singapore and UAE that too into education industry will be highly preferred
3. Building highly optimized team through successful employee engagement and retention, addition to that, also taking care of the growth, development, and goal achievement
4. Optimizing revenue of the organization by meeting weekly/monthly/quarterly targets
5. Leader will be responsible to work on customer success for client retention and satisfaction.
6. Setting of targets for the team to ensure they achieve team goals.
7. Identification & resolution of day-to-day operational challenges
8. Allocate work to team & coordinates resources to meet short-term/long term goals
9. Use of effective tact and diplomacy to exchange information and handle sensitive issues within the team
10. Conduct daily/weekly hurdles to monitor/motivate team
11. Maintaining strong connection/relation with the team to ensure smooth operation
12. Assign work to team members based on their skills, development needs and availability
13. Training team member to ensure every recourse/team member is tuned to perform best tasks as per individual capability and skills.
14. Handle escalation of the client to provide customer success
15. Remains up-to-date on the current trends and issues in customer education, and is familiar with competency frameworks and curriculum development