3+ PySpark Jobs in Indore | PySpark Job openings in Indore

About Kanerika:

Kanerika Inc. is a premier global software products and services firm that specializes in providing innovative solutions and services for data-driven enterprises. Our focus is to empower businesses to achieve their digital transformation goals and maximize their business impact through the effective use of data and AI.

We leverage cutting-edge technologies in data analytics, data governance, AI-ML, GenAI/ LLM and industry best practices to deliver custom solutions that help organizations optimize their operations, enhance customer experiences, and drive growth.

Awards and Recognitions:

Kanerika has won several awards over the years, including:

1. Best Place to Work 2023 by Great Place to Work®

2. Top 10 Most Recommended RPA Start-Ups in 2022 by RPA Today

3. NASSCOM Emerge 50 Award in 2014

4. Frost & Sullivan India 2021 Technology Innovation Award for its Kompass composable solution architecture

5. Kanerika has also been recognized for its commitment to customer privacy and data security, having achieved ISO 27701, SOC2, and GDPR compliances.

Working for us:

Kanerika is rated 4.6/5 on Glassdoor, for many good reasons. We truly value our employees' growth, well-being, and diversity, and people’s experiences bear this out. At Kanerika, we offer a host of enticing benefits that create an environment where you can thrive both personally and professionally. From our inclusive hiring practices and mandatory training on creating a safe work environment to our flexible working hours and generous parental leave, we prioritize the well-being and success of our employees.

Our commitment to professional development is evident through our mentorship programs, job training initiatives, and support for professional certifications. Additionally, our company-sponsored outings and various time-off benefits ensure a healthy work-life balance. Join us at Kanerika and become part of a vibrant and diverse community where your talents are recognized, your growth is nurtured, and your contributions make a real impact. See the benefits section below for the perks you’ll get while working for Kanerika.

Role Responsibilities: 

Following are high level responsibilities that you will play but not limited to: 

• Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes.
• Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.
• Enable business analytics and self-service reporting through Power BI and other visualization tools.
• Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions.
• Implement and enforce best practices for data governance, data quality, and security.
• Mentor and guide junior data engineers; establish coding and design standards.
• Evaluate emerging technologies and tools to continuously improve the data ecosystem.

Required Qualifications:

• Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
• Bachelor’s/Master’s degree in Computer Science, Information Technology, Engineering, or related field.
• 7+ years of experience in data engineering or data platform development, with at least 2–3 years in a lead or architect role.
• Strong hands-on experience in one or more of the following:
• Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse)
• Databricks (Spark, Delta Lake, PySpark, MLflow)
• Snowflake (Data Warehousing, Snowpipe, Performance Optimization)
• Power BI (Data Modeling, DAX, Report Development)
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with Azure, AWS, or GCP cloud data services.
• Solid understanding of data modeling, data governance, security, and CI/CD practices.

Preferred Qualifications:

• Familiarity with data modeling techniques and practices for Power BI.
• Knowledge of Azure Databricks or other data processing frameworks.
• Knowledge of Microsoft Fabric or other Cloud Platforms.

What we need?

· B. Tech computer science or equivalent.

Why join us?

• Work with a passionate and innovative team in a fast-paced, growth-oriented environment.
• Gain hands-on experience in content marketing with exposure to real-world projects.
• Opportunity to learn from experienced professionals and enhance your marketing skills.
• Contribute to exciting initiatives and make an impact from day one.
• Competitive stipend and potential for growth within the company.
• Recognized for excellence in data and AI solutions with industry awards and accolades.

Employee Benefits:

1. Culture:

• Open Door Policy: Encourages open communication and accessibility to management.
• Open Office Floor Plan: Fosters a collaborative and interactive work environment.
• Flexible Working Hours: Allows employees to have flexibility in their work schedules.
• Employee Referral Bonus: Rewards employees for referring qualified candidates.
• Appraisal Process Twice a Year: Provides regular performance evaluations and feedback.

2. Inclusivity and Diversity:

• Hiring practices that promote diversity: Ensures a diverse and inclusive workforce.
• Mandatory POSH training: Promotes a safe and respectful work environment.

3. Health Insurance and Wellness Benefits:

• GMC and Term Insurance: Offers medical coverage and financial protection.
• Health Insurance: Provides coverage for medical expenses.
• Disability Insurance: Offers financial support in case of disability.

4. Child Care & Parental Leave Benefits:

• Company-sponsored family events: Creates opportunities for employees and their families to bond.
• Generous Parental Leave: Allows parents to take time off after the birth or adoption of a child.
• Family Medical Leave: Offers leave for employees to take care of family members' medical needs.

5. Perks and Time-Off Benefits:

• Company-sponsored outings: Organizes recreational activities for employees.
• Gratuity: Provides a monetary benefit as a token of appreciation.
• Provident Fund: Helps employees save for retirement.
• Generous PTO: Offers more than the industry standard for paid time off.
• Paid sick days: Allows employees to take paid time off when they are unwell.
• Paid holidays: Gives employees paid time off for designated holidays.
• Bereavement Leave: Provides time off for employees to grieve the loss of a loved one.

6. Professional Development Benefits:

• L&D with FLEX- Enterprise Learning Repository: Provides access to a learning repository for professional development.
• Mentorship Program: Offers guidance and support from experienced professionals.
• Job Training: Provides training to enhance job-related skills.
• Professional Certification Reimbursements: Assists employees in obtaining professional      certifications.
• Promote from Within: Encourages internal growth and advancement opportunities.

We are looking for a skilled and passionate Data Engineers with a strong foundation in Python programming and hands-on experience working with APIs, AWS cloud, and modern development practices. The ideal candidate will have a keen interest in building scalable backend systems and working with big data tools like PySpark.

Key Responsibilities:

• Write clean, scalable, and efficient Python code.
• Work with Python frameworks such as PySpark for data processing.
• Design, develop, update, and maintain APIs (RESTful).
• Deploy and manage code using GitHub CI/CD pipelines.
• Collaborate with cross-functional teams to define, design, and ship new features.
• Work on AWS cloud services for application deployment and infrastructure.
• Basic database design and interaction with MySQL or DynamoDB.
• Debugging and troubleshooting application issues and performance bottlenecks.

Required Skills & Qualifications:

• 4+ years of hands-on experience with Python development.
• Proficient in Python basics with a strong problem-solving approach.
• Experience with AWS Cloud services (EC2, Lambda, S3, etc.).
• Good understanding of API development and integration.
• Knowledge of GitHub and CI/CD workflows.
• Experience in working with PySpark or similar big data frameworks.
• Basic knowledge of MySQL or DynamoDB.
• Excellent communication skills and a team-oriented mindset.

Nice to Have:

• Experience in containerization (Docker/Kubernetes).
• Familiarity with Agile/Scrum methodologies.

• Does analytics to extract insights from raw historical data of the organization. 
• Generates usable training dataset for any/all MV projects with the help of Annotators, if needed.
• Analyses user trends, and identifies their biggest bottlenecks in Hammoq Workflow.
• Tests the short/long term impact of productized MV models on those trends.
• Skills - Numpy, Pandas, SPARK, APACHE SPARK, PYSPARK, ETL mandatory.