Cutshort logo
Global digital transformation solutions provider.  logo
Lead II - Data Engineering -Python - Databricks, PySpark, Python
Global digital transformation solutions provider.
Lead II - Data Engineering -Python - Databricks, PySpark, Python
Peak Hire Solutions's logo

Lead II - Data Engineering -Python - Databricks, PySpark, Python

at Global digital transformation solutions provider.

Agency job
7 - 9 yrs
₹15L - ₹28L / yr
Bengaluru (Bangalore)
Skills
databricks
skill iconPython
SQL
PySpark
skill iconAmazon Web Services (AWS)
ETL
Informatica
Performance tuning
AWS Lambda
Amazon Redshift
Data modeling
CI/CD
skill iconGit
EMR

Role Proficiency:

This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required.


Skill Examples:

  1. Proficiency in SQL Python or other programming languages used for data manipulation.
  2. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.
  3. Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).
  4. Conduct tests on data pipelines and evaluate results against data quality and performance specifications.
  5. Experience in performance tuning.
  6. Experience in data warehouse design and cost improvements.
  7. Apply and optimize data models for efficient storage retrieval and processing of large datasets.
  8. Communicate and explain design/development aspects to customers.
  9. Estimate time and resource requirements for developing/debugging features/components.
  10. Participate in RFP responses and solutioning.
  11. Mentor team members and guide them in relevant upskilling and certification.

 

Knowledge Examples:

  1. Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.
  2. Proficient in SQL for analytics and windowing functions.
  3. Understanding of data schemas and models.
  4. Familiarity with domain-related data.
  5. Knowledge of data warehouse optimization techniques.
  6. Understanding of data security concepts.
  7. Awareness of patterns frameworks and automation practices.


 

Additional Comments:

# of Resources: 22 Role(s): Technical Role Location(s): India Planned Start Date: 1/1/2026 Planned End Date: 6/30/2026

Project Overview:

Role Scope / Deliverables: We are seeking highly skilled Data Engineer with strong experience in Databricks, PySpark, Python, SQL, and AWS to join our data engineering team on or before 1st week of Dec, 2025.

The candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and analytics solutions that drive business insights and operational efficiency.

Design, build, and maintain scalable data pipelines using Databricks and PySpark.

Develop and optimize complex SQL queries for data extraction, transformation, and analysis.

Implement data integration solutions across multiple AWS services (S3, Glue, Lambda, Redshift, EMR, etc.).

Collaborate with analytics, data science, and business teams to deliver clean, reliable, and timely datasets.

Ensure data quality, performance, and reliability across data workflows.

Participate in code reviews, data architecture discussions, and performance optimization initiatives.

Support migration and modernization efforts for legacy data systems to modern cloud-based solutions.


Key Skills:

Hands-on experience with Databricks, PySpark & Python for building ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration (Airflow preferred).

Excellent problem-solving, communication, and collaboration skills.

 

Skills: Databricks, Pyspark & Python, Sql, Aws Services

 

Must-Haves

Python/PySpark (5+ years), SQL (5+ years), Databricks (3+ years), AWS Services (3+ years), ETL tools (Informatica, Glue, DataProc) (3+ years)

Hands-on experience with Databricks, PySpark & Python for ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, Git, and workflow orchestration (Airflow preferred).


******

Notice period - Immediate to 15 days

Location: Bangalore

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Volga Infosys Private Limited
at Volga Infosys Private Limited
2 candid answers
Neha Dhalia
Posted by Neha Dhalia
Ludhiana, Jodhpur
1 - 2 yrs
₹2L - ₹4L / yr
Virtual reality (VR)
Augmented reality
Unity 3D

Job Summary

We are looking for a skilled VR Developer to design, develop, and optimize immersive virtual reality applications. The ideal candidate should have strong experience in Unity/Unreal Engine, 3D environments, and interactive experiences, with a passion for emerging technologies.

Key Responsibilities

  • Design and develop immersive VR applications and experiences
  • Build interactive 3D environments using Unity or Unreal Engine
  • Integrate VR hardware such as Oculus, HTC Vive, Meta Quest
  • Optimize performance, frame rate, and user experience
  • Collaborate with designers, artists, and developers to deliver high-quality VR content
  • Implement physics, animations, and user interactions
  • Debug, test, and maintain VR applications
  • Stay updated with the latest VR/AR trends and technologies

Required Skills & Qualifications

  • Strong experience with Unity (C#) or Unreal Engine (Blueprints/C++)
  • Knowledge of 3D modeling, textures, lighting, and shaders
  • Experience with VR SDKs (OpenXR, Oculus SDK, SteamVR)
  • Understanding of game mechanics and UX for VR
  • Familiarity with version control tools (Git)
  • Ability to optimize applications for VR performance
  • Good problem-solving and communication skills

Preferred Skills (Good to Have)

  • Experience with AR/VR technologies
  • Knowledge of Blender, Maya, or 3ds Max
  • Experience in multiplayer or networked VR
  • Understanding of AI integration in VR
  • Experience with cross-platform VR development


Read more
Real Estate Builders & Construction Company
Real Estate Builders & Construction Company
Agency job
via Jobdost by Saida Pathan
Chennai
3 - 10 yrs
₹5L - ₹7L / yr
skill iconPHP
skill iconLaravel
skill iconJavascript
skill iconHTML/CSS
User Interface (UI) Design
+21 more

Position: SR. WEB APPLICATION DEVELOPER 

Job Responsibilities:

 

  • Should maintain Apache web server (LAMP & WHM/CPanel).
  • Create and Maintain PHP, Laravel Based web application / HTML, CSS & JS wireframes / mockups, websites , web assets , Landing pages.
  • Conceptualize original ideas that bring simplicity and user friendliness on web sites and web applications.
  • Create and Maintain WordPress Websites, Plug-Ins and Themes using the latest development and deployment methodologies.
  • Create and Maintain high-performance websites with SEO and SEM integrations and managing all technical aspects of the CMS.
  • On time delivery - Ensuring the project is delivered on time through continual improvement.
  • Quality Benchmark - Ensure that the project is delivered with best quality and with minimal bugs.
  • Ensuring effective and timely communication with the project stakeholders and team members.
  • Process Compliance / Adherence to style standards on fonts, colors, images, design guidelines, best practices and standards.


Job Requirements:

  • Strong understanding of Apache Server with LAMP & WHM/CPanel.
  • Strong understanding of php & Laravel based app development life-cycle and best practices and CMS management.
  • At least 5+ years of experience working in Laravel, WordPress / HTML 5 / CSS3 / JavaScript / PHP and NodeJS technologies
  • Must have experience in building and managing websites for large consulting firms or large publishing house or large content marketing company
  • Strong experience in building rapid prototypes and wireframes using HTML 5 / CSS 3 / JavaScript
  • Must have experience in developing responsive , multi platform , cross browser / multi resolution user interfaces and design
  • Must have Basic knowledge in SEO / SEM
  • Must have experience in building new themes and plugins on WordPress CMS and integration with external systems using RESTful APIs and formats (JSON, XML)
  • Proficiency in ReactJS with Redux or Angular will be an added advantage
  • Ability to work with business leaders / multiple teams.
  • Ability to recommend intuitive user journeys / interfaces and proactively evolve product design
  • Excellent communication, interpersonal, and organizational skills


SKILLS:


Laravel, WordPress , PHP , WHM/CPanel, DigitalOcean, HTML5 , CSS3 , JavaScript , Bootstrap , jQuery , RESTful APIs and formats (JSON, XML) , ReactJS with Redux , Angular, Debugging Tools , User Interface Design Concepts , Adobe Photoshop, Adobe Illustrator, SEO / SEM.

 

Read more
Diyos Infotech Pvt Ltd
Chandana Mallemoggala
Posted by Chandana Mallemoggala
Madhupur, Hyderabad
1 - 2 yrs
₹2L - ₹2.5L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+4 more

Description

We are looking for a Java Developer with experience in building high-performing, scalable, enterprise-grade applications. You will be part of a talented software team that works on mission-critical applications. Java developer roles and responsibilities include managing Java/Java EE application development while providing expertise in the full software development lifecycle, from concept and design to testing. Java developer responsibilities include designing, developing and delivering high-volume, low-latency applications for mission-critical systems.


Responsibilities

·      Contribute in all phases of the development lifecycle

·      Write well designed, testable, efficient code

·      Ensure designs are in compliance with specifications

·      Prepare and produce releases of software components

·      Support continuous improvement by investigating alternatives and technologies and presenting these for architectural review


Requirements

·      BS/MS degree in Computer Science, Engineering or a related subject

·      Proven hands-on Software Development experience

·      Proven working experience in Java development

·      Hands on experience in designing and developing applications using Java EE platforms

·      Object Oriented analysis and design using common design patterns.

·      Profound insight of Java and JEE internals (Class loading, Memory Management, Transaction management etc)

·      Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)

·      Experience in the Spring Framework

·      Experience as a Sun Certified Java Developer

·      Experience in developing web applications using at least one popular web framework (JSF, Wicket, GWT, Spring MVC)

·      Experience with test-driven development

Read more
Bansal Fine Foods Pvt Ltd
Karnal
2 - 5 yrs
₹2L - ₹3L / yr
Microsoft Excel
skill iconGoogle Analytics
Communication Skills
1. Expert in Microsoft Advance Excel with expertise in functions like Index, Match, nested functions, delimiter, arrays, conditional formatting
2. Expert in Excel skills, Google sheet, and Google app coding
3. Good communication skills in English, Hindi
4. Good follow-up skills
5. Maths should be good
6. Ready to learn attitude is the most important
Read more
MAJD Digital
Devika Atree
Posted by Devika Atree
Remote only
2 - 6 yrs
₹7.5L - ₹30L / yr
skill iconReact Native
skill iconAndroid Development
skill iconiOS App Development
User Interface (UI) Development
About us :

We are building 25+ years of strong regional business acumen, deep relations, and experienced management to revolutionaries trade through comprehensive digital platform and to fulfill the needs of consumers, retailers, suppliers, distributors and manufacturers through digital brands with a vision to disrupt, build, and own the retail business value chain in each market.

We at the present have our presence in UAE, India, Iraq and Saudi Arabia.

Job Description :

- Architect, build and maintain excellent React Native applications with clean code

- Technical design of complex mobile applications

- Implement pixel perfect UI's that match designs

- Implement clean, modern, smooth animations and transitions that provide an excellent user experience.

- Integrate third-party API's.

- Write unit and integration tests.

- Release applications to IOS and Google Play stores.

- Work with native modules when required

- Guide team members for design and implementation tasks

- Co-ordinate end-to-end implementation

- Cooperate with back-end developers, designers, and the rest of the team to deliver well-architected and high-quality solutions.

Perks of working with us :

- Objectives are set to help you align and contribute to the mission

- Ample opportunities for interacting with customers, product managers and the leadership

- You will self-asses your progress while managers will guide you through continuous feedforward.

- Leverage and build strong connections across communities of interests

- Pick your Mentor to help you navigate the present and drive your future

- Continuous learning and upskilling through Nexversity

- Flexibility to move across functions, skills and technologies

- Hybrid work mode to drive balance
Read more
Rapido
at Rapido
16 recruiters
Amit Kumar  Padashetty
Posted by Amit Kumar Padashetty
Bengaluru (Bangalore)
1 - 5 yrs
₹1L - ₹45L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode
Reports To: Tech Lead
Department: Engineering
People Management (Yes/No): No
 
 
OUR CAUSE:
Rapido is India’s largest bike taxi player focused on solving the first and last mile connectivity problem for India. The primary focus is mobility and changing all facets of mobility across India. We believe that 2 Wheeler are the right mode of transport for developing countries like India and have much more scope than 4 wheelers, which is also reflected in the fact that the number of 2 wheelers is significantly more than the number of 4-wheelers.We have operations in close to 100 cities and are the undisputed market leader in this space. Growing close to 500% year-on-year, we have ambitious targets set for ourselves in the future as well.
 
Key Responsibilities:
  • Own the delivery of multiple features of the product end to end while hands-on in development as well
  • Advocate best development practices such as continuous integration/continuous delivery, automation (testing and infrastructure) and code modularity, extensibility, quality
  • Adopt security- first approach in the product development and ensure automated and manual security checks in place across the delivery pipeline
  • Lead by example and mentor other developers in the team both technically and professionally
  • Support other Senior Product Engineers and contribute to their growth professionally
  • Work with  tech leads and the team to ensure shared technology vision and develop state of the art design and architecture for any product development
  • Work with other functions such as testing, analysis, infra management, support to ensure faster delivery of products
  • Ensure timely and accurate communication with broader team in order to share understanding of product functionality, features, and technology vision
  • Look out for technology trends across the industry and apply relevant developments to the products
  • Work with the decentralised application business owners to ensure their vision is realised through efficient technology and delivery timelines
  • Work in a dynamic, collaborative, transparent, non-hierarchical, and ego-free culture where your talent is valued over a role title 
  • Develop personally and professional outside of the confinement of a traditional career path by focusing on what you’re passionate about rather than a predetermined one-size-fits-all plan 
Qualifications:
  • Must have extensive hands on experiencing designing and building mobile applications on Android
  • Must have excellent programming, debugging and scripting skills with a solid understanding of Object-Oriented Design principles
  • Must have ability to learn/iterate quickly in a rapidly changing technical stack with nascent codebase and developer tools
  • Must possess a passion for delivery-focused development, and overcoming challenges through teamwork and self-motivation
  • Ability to work in a variety of client settings and in a team-oriented, collaborative environment 
  • Ability to communicate technical vision and direction of the product and make significant impacts to technology and design choices
 
Experience:
  • Architectural design while leading and inspiring software development teams 
  • Leading development of large, custom-built object-oriented applications 
  • Continuous integration tools and test automation
  • Managing systems in production and understands release process, monitoring, and debugging
  • Working and developing in agile environment working with XP/Scrum development practices
 
Skills and Competencies:
  • Expertise in end to end Android development and release management
  • Proficiency in at least two of the following: Java,  NodeJS, Go, JavaScript, Python programming stacks, and passion for software engineering and craftsman-like coding prowess 
  • Knowledge of software practices like refactoring, clean code, domain driven design, Encapsulation etc 
  • Hands on experience managing databases like MongoDB, Cassandra, Redis
  • Exposure to event driven systems and event streaming engines like Kafka
  • Good knowledge of DevOps tooling like docker, kubernetes, ansible/chef, AWS.
  • Solid OO skills, including strong design patterns knowledge and enterprise integration
 
WHY SHOULD YOU JOIN RAPIDO
We’ve scaled 10x within 1 year and currently doing 3.5+ Lakh orders per day. Our growth outshines our goals and we want you to be a part of the growth solving fundamental mobility problems for India. You can be part of the team that is helping daily commuters with economic and quicker rides. 
At Rapido, we take our work seriously and are proud of the associations we have built along the way. But then, we also know how to have fun. With a seamless communication structure and a “no cubicle culture”, the people here are extremely approachable. You will have several opportunities to exercise your potential, you won’t be disappointed. We break the regular office monotony and believe in free-flowing work culture.
Read more
Khatavahi BI Solutions LLP
Pritesh Bhanderi
Posted by Pritesh Bhanderi
Surat
0 - 1 yrs
₹1L - ₹2L / yr
skill iconNodeJS (Node.js)
skill iconJavascript
skill iconMongoDB
skill iconExpress
We are looking for a Nodejs developer who can be in the fast-growing team.
- You will be working on Designing the Database, writing low latency microservice architecture in node js, express js.
-  If you have basic knowledge of reactjs that would be plus for you as well as us.
Read more
Helios Solutions
at Helios Solutions
1 recruiter
Sagar Valand
Posted by Sagar Valand
Vadodara
4 - 10 yrs
₹6L - ₹15L / yr
DevOps
skill iconJenkins
Ansible
skill iconAmazon Web Services (AWS)
Senior Engineer - DevOps

 

We are looking for a Sr. Engineer DevOps and SysOps, who is responsible for managing AWS and Azure cloud computing.  Your primary focus would be to help multiple projects with various cloud service implementation, create and manage CI/CD pipelines for deployment, explore new services on cloud and help projects to implement them.

Technical Requirements & Responsibilities

  1. Have 4+ years’ experience as a DevOps and SysOps Engineer.
  2. Apply cloud computing skills to deploy upgrades and fixes on AWS and Azure (GCP is optional / Good to have).
  3. Design, develop, and implement software integrations based on user feedback.
  4. Troubleshoot production issues and coordinate with the development team to streamline code deployment.
  5. Implement automation tools and frameworks (CI/CD pipelines).
  6. Analyze code and communicate detailed reviews to development teams to ensure a marked improvement in applications and the timely completion of projects.
  7. Collaborate with team members to improve the company’s engineering tools, systems and procedures, and data security.
  8. Optimize the company’s computing architecture.
  9. Conduct systems tests for security, performance, and availability.
  10. Develop and maintain design and troubleshooting documentation.
  11. Expert in code deployment tools (Puppet, Ansible, and Chef).
  12. Can maintain Java / PHP / Ruby on Rail / DotNet web applications.
  13. Experience in network, server, and application-status monitoring.
  14. Possess a strong command of software-automation production systems (Jenkins and Selenium).
  15. Expertise in software development methodologies.
  16. You have working knowledge of known DevOps tools like Git and GitHub.
  17. Possess a problem-solving attitude.
  18. Can work independently and as part of a team.

Soft Skills Requirements

  1. Strong communication skills
  2. Agility and quick learner
  3. Attention to detail
  4. Organizational skills
  5. Understanding of the Software development life cycle
  6. Good Analytical and problem-solving skills
  7. Self-motivated with the ability to prioritize, meet deadlines, and manage changing priorities
  8. Should have a high level of energy working as an individual contributor and as a part of team.
  9. Good command over verbal and written English communication

 

Read more
Whitehat jr
at Whitehat jr
13 recruiters
Kruti Patel
Posted by Kruti Patel
Mumbai
0 - 12 yrs
₹4L - ₹9L / yr
Sales
Communication Skills
Customer Service

About Whitehat Jr

WhiteHat Jr was created to solve the #1 gap in our school system today. Today, in the computer age, less than 1% of schools teach algorithmic thinking despite research indicating early years as the turning point for deep coding skills. WhiteHat Jr prepares kids 5-12 for this new world. Kids learn both the fundamentals of coding--logic, sequence, structure, algorithmic thinking - and experience the joy of creative expression in building animations, games and apps using code.

About the role

We’re seeking a qualified Sales Manager to sell Whitehat Jr’s product that our customers have grown to rely on. The Sales Manager will utilise their skills to generate high quality leads, build a strong relationship with customers and close deals. The ideal candidate will be a quick learner with strong negotiating skills, and demonstrate the ability to showcase our offerings in a compelling way.

Role details (please read)

Scope: Exceed targets for New Sales, Referrals or Renewals, in an individual contributor role

Work Location: Remote online work until offices reopen, candidate may be based anywhere in India

Working days: 6 working days with 1 day-off which may be during week

Shifts (subject to change): shift start hour will be after 6 AM and shift end hour before 12 midnight

Mandatory Language Fluency: English, Hindi

Laptop/Wi-fi: candidates to use their own laptops, wi-fi will be reimbursed

Additional Compensation: If applicable, this will be decided basis your allocated shift after you join

Qualifications

  • Proven B2C Sales track record of exceeding targets, >2 years of Sales experience
  • Fluency in English and Hindi, ability and willingness to deliver in a high pressure environment
  • Excellent communication, interpersonal, problem-solving, presentation, and organisational skills.
  • Ability to counsel a parent for the child's future
  • Comfortable with changing shift timings so that we may serve our customers better
  • Graduation is not mandatory for candidates with minimum 6mnths of experience
  • Graduation & MBA fresher can apply
  • Working knowledge of Salesforce, spreadsheets (Excel, Google Sheets ) and powerpoint
Read more
Optymyze
at Optymyze
1 recruiter
Madhushree Kumra
Posted by Madhushree Kumra
Pune
7 - 11 yrs
₹12L - ₹18L / yr
Designing
skill iconJava
J2EE
Interpersonal Skills
skill iconLeadership
A Software Development Lead at Optymyze typically reports to Software Development Manager and will be responsible for multiple project teams involved in developing and maintaining a group of modules and products belonging to Optymyze’s applications.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos