2+ Apache Spark Jobs in Indore | Apache Spark Job openings in Indore

Position: Team Lead – Data Engineering

Client: NucleusTeq

We are looking for an experienced Team Lead / Architect – Data Engineer to design, architect, and lead scalable cloud-based data platforms.

Key Responsibilities:

·     Design and architect scalable, high-performance data solutions.

·     Lead and mentor a team of data engineers.

·     Build and optimize large-scale data pipelines.

·     Drive architectural decisions and technical strategy.

·     Ensure data quality, governance, and security best practices.

·     Collaborate with cross-functional teams for end-to-end delivery.

Required Skills:

·     Strong hands-on experience in Java & Python.

·     Strong expertise in SQL and Big Data technologies.

·     Hands-on experience with Google Cloud Platform (GCP).

·     Experience with Apache Airflow for workflow orchestration.

·     Strong understanding of distributed systems and data architecture.

·     Experience in CI/CD pipelines (mandatory).

·     Experience in data warehousing and ETL processes.

·     Excellent leadership and stakeholder management skills.

Good to Have:

·     Experience with Dataflow (Apache Beam).

·     Experience designing enterprise-level data platforms.

·     Exposure to DevOps best practices.

• Does analytics to extract insights from raw historical data of the organization. 
• Generates usable training dataset for any/all MV projects with the help of Annotators, if needed.
• Analyses user trends, and identifies their biggest bottlenecks in Hammoq Workflow.
• Tests the short/long term impact of productized MV models on those trends.
• Skills - Numpy, Pandas, SPARK, APACHE SPARK, PYSPARK, ETL mandatory.