Cutshort logo
For Employers
Global digital transformation solutions provider.  logo
Lead II - Data Engineering -Python - Databricks, PySpark, Python
Global digital transformation solutions provider.
Lead II - Data Engineering -Python - Databricks, PySpark, Python

Lead II - Data Engineering -Python - Databricks, PySpark, Python at Global digital transformation solutions provider. · Bengaluru (Bangalore) · 7 - 9 years · ₹15L - ₹28L / yr · Posted 15 Dec 2025

Peak Hire Solutions's logo

Lead II - Data Engineering -Python - Databricks, PySpark, Python

at Global digital transformation solutions provider.

Agency job
7 - 9 yrs
₹15L - ₹28L / yr
Bengaluru (Bangalore)
Skills
databricks
skill iconPython
SQL
PySpark
skill iconAmazon Web Services (AWS)
ETL
Informatica
Performance tuning
AWS Lambda
Amazon Redshift
Data modeling
CI/CD
skill iconGit
EMR

Role Proficiency:

This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required.


Skill Examples:

  1. Proficiency in SQL Python or other programming languages used for data manipulation.
  2. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.
  3. Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).
  4. Conduct tests on data pipelines and evaluate results against data quality and performance specifications.
  5. Experience in performance tuning.
  6. Experience in data warehouse design and cost improvements.
  7. Apply and optimize data models for efficient storage retrieval and processing of large datasets.
  8. Communicate and explain design/development aspects to customers.
  9. Estimate time and resource requirements for developing/debugging features/components.
  10. Participate in RFP responses and solutioning.
  11. Mentor team members and guide them in relevant upskilling and certification.

 

Knowledge Examples:

  1. Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.
  2. Proficient in SQL for analytics and windowing functions.
  3. Understanding of data schemas and models.
  4. Familiarity with domain-related data.
  5. Knowledge of data warehouse optimization techniques.
  6. Understanding of data security concepts.
  7. Awareness of patterns frameworks and automation practices.


 

Additional Comments:

# of Resources: 22 Role(s): Technical Role Location(s): India Planned Start Date: 1/1/2026 Planned End Date: 6/30/2026

Project Overview:

Role Scope / Deliverables: We are seeking highly skilled Data Engineer with strong experience in Databricks, PySpark, Python, SQL, and AWS to join our data engineering team on or before 1st week of Dec, 2025.

The candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and analytics solutions that drive business insights and operational efficiency.

Design, build, and maintain scalable data pipelines using Databricks and PySpark.

Develop and optimize complex SQL queries for data extraction, transformation, and analysis.

Implement data integration solutions across multiple AWS services (S3, Glue, Lambda, Redshift, EMR, etc.).

Collaborate with analytics, data science, and business teams to deliver clean, reliable, and timely datasets.

Ensure data quality, performance, and reliability across data workflows.

Participate in code reviews, data architecture discussions, and performance optimization initiatives.

Support migration and modernization efforts for legacy data systems to modern cloud-based solutions.


Key Skills:

Hands-on experience with Databricks, PySpark & Python for building ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration (Airflow preferred).

Excellent problem-solving, communication, and collaboration skills.

 

Skills: Databricks, Pyspark & Python, Sql, Aws Services

 

Must-Haves

Python/PySpark (5+ years), SQL (5+ years), Databricks (3+ years), AWS Services (3+ years), ETL tools (Informatica, Glue, DataProc) (3+ years)

Hands-on experience with Databricks, PySpark & Python for ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, Git, and workflow orchestration (Airflow preferred).


******

Notice period - Immediate to 15 days

Location: Bangalore

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Mumbai
8 - 12 yrs
₹10L - ₹15L / yr
Corporate Communications
Corporate Training
Screening
Performance Evaluation

Company Name : Enlink Managed Services

Company Website : https://enlinkit.com/

Job Description Technical Evaluator (Corporate Trainers)

Work Location: Turbhe, Navi Mumbai

Employment Type: Full-Time (Work from Office)

Experience Required: 8 to 10 Years

Salary Range:

Preferred Candidate Location: Navi Mumbai / Thane / Mumbai

Industry: IT Services Corporate Training & Consulting


Qualifications:

Bachelor’s degree in Engineering / Computer Science / IT or relevant field

8–10 years of experience in trainer evaluation, technical hiring, or L&D


Job Summary:

Enlink Managed Services is looking for a detail-oriented Technical Evaluator to evaluate and shortlist corporate trainer profiles based on their technical competence and training delivery capabilities. This role involves technical screening, evaluation discussions, quality checks, and maintaining structured trainer evaluation reports.


Key Responsibilities:

Review and screen trainer profiles based on technical capabilities and training experience

Conduct technical interviews and competency mapping of trainers

Evaluate trainers on communication skills and training delivery capability

Review and screen trainer profiles based on technical capabilities and training experience

Conduct technical interviews and competency mapping of trainers

Evaluate trainers on communication skills and training delivery capability

Maintain tracker reports, evaluation sheets, and trainer scorecards in Excel

Maintain a strong database of empaneled trainers across multiple technologies

Provide feedback and rating for shortlisted trainers

Ensure trainer quality standards as per company and client requirements

Coordinate with Sales teams to understand client requirements

Validate trainers’ course content, training methodology, and learning outcomes

Ensure only technically qualified trainers are empanelled

Assist in building a strong technical trainer pipeline across multiple domains

Maintain confidentiality and uphold evaluation standards


Required Skills :

Experience in profile evaluation or technical screening

Strong understanding of corporate training standards

Excellent communication skills (spoken and written)

Strong MS Excel skills – evaluation reports, scorecards, filters, trackers

Ability to conduct structured evaluation calls and technical validations

Detail-oriented, organized, and professional

Ability to manage multiple trainer evaluations and meet deadlines

Read more
SutraHR
Kashish Ravariya
Posted by Kashish Ravariya
Andheri (West), Mumbai
1 - 4 yrs
₹25L - ₹30L / yr
Lead Generation
Sales
Customer Relationship Management (CRM)
Communication Skills
Business Development

We are looking for a highly motivated and results-driven Business Development Professional to join our team. The role involves identifying new business opportunities, building strong client relationships, and driving revenue growth. The ideal candidate should have excellent communication skills, a strong understanding of sales processes, and the ability to convert leads into long-term partnerships.


Key Responsibilities

  • Identify and generate new business opportunities through market research, networking, and cold outreach.
  • Develop and maintain strong relationships with potential and existing clients.
  • Understand client needs and propose suitable services to address their requirements.
  • Create and deliver sales presentations, proposals, and pitches.
  • Maintain accurate records of leads, opportunities, and client interactions in CRM tools.
  • Stay updated with industry trends, competitor activities, and market dynamics.


Read more
Kesari Tours Pvt Ltd
Pune
2 - 5 yrs
₹5L - ₹15L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+3 more

We are looking for a PHP + Laravel Developer responsible for managing back-end services and the interchange of data between the different cloud applications across all verticals. Your primary focus will be the development of all server-side logic, definition, and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end .


Why join Kesari Awayddings?

We are super aggressive and believe in a strong vision. We love building products that solve real problems and you get to write code across multiple technologies and do actual stuff. We are reimagining and reengineering the Destination wedding Industry & its ecosystem through intelligent and innovative technology.

Responsibilities: • Build efficient, testable, and reusable PHP and NodeJS modules • Solve complex performance problems and architectural challenges • Integration of data storage solutions (AWS S3, Redis, Memcache) • Architecting NodeJS-based scalable microservices. • AWS deployment, CI-CD pipelining. • Designing and developing APIs.

Skills & Knowledge:

Minimum 2 years of experience is mandatory - Strong knowledge of PHP web frameworks (Laravel) - Understanding of MVC design patterns - Basic understanding of HTML5, and CSS3 - Knowledge of object-oriented PHP programming - Knowledge of JS frameworks like ES6 Express and GraphQL - Understanding fundamental design principles behind a scalable application. - User authentication and authorization between multiple systems, servers, and environments. - Familiarity with limitations of PHP as a platform and its workarounds - Creating database schemas that represent and support business processes - Knowledge of SQL, MySQL, MongoDB or similar database management systemExposure to or experience with AWS- ElasticBeanStalk, Load Balancer, S3, EC2, Git/ Bitbucket/Jira/Jenkins, etc - Optional - Familiarity with JavaScript frameworks such as Vue JS or React is a plus

What’s in it for you? • Opportunity to be a part of the core team, working closely with founding team members • The steep learning curve with great exposure to all the aspects of start-ups • A performance-based environment with no limits to career growth and personal development • An opportunity to collaborate with a team of like-minded, smart, creative people who execute and get things done. • Platform to fulfil your entrepreneurship dream and a chance to witness the exponential growth of a company • ESOPS discussion can happen depending on the performance

The Job location is Pune If you’re passionate about web platforms and translating code into user-friendly products, we would like to meet you.






Your LinkedIn Profile link Your GitHub link Any stackoverflow contribution is a plus Projects you have developed so far, along with links and reference


Read more
IT by Design
Somya Girdhar
Posted by Somya Girdhar
Noida, Chandigarh
1 - 3 yrs
₹3L - ₹4.2L / yr
International experience
Customer Support
Effective communication
Technical support

responsibilities

• Troubleshooting on Desktops.

• Troubleshooting on Microsoft office 365, firewall and mail servers

. • Monitoring backups.

• Troubleshooting networks, virtualization, and windows servers. Capabilities


Skills

• Technology Graduate OR Bachelor of Science in IT

. • Must have a prior minimum 1 year of experience in customer service or technical support role.

• Effective interpersonal skills and relationship-building skills. • Strong written and oral communication skills (Must have).

• Strong analytical and problem-solving abilities, with keen attention to detail.

• Must be a team player but should also understand the importance of individual contributions.

• Self-motivated and directed, able to effectively prioritize and execute tasks in a high-pressure environment.

• Must be flexible to work any shift in a 24/7 operation including night shifts.

• Candidate should be open for transfer to another location or office, if the job requires so or in the interest of the business requirements. • The work location will be decided by the Organization depending upon the business requirement

. • Candidate should be amendable to work from office. Behavioral Skills

• Longevity and commitment in previous work

• Team player

• Ability to meet target under pressure and time bound deadlines.

Read more
FlyyX Technologies Pvt Limited
Deepshikha Sethi
Posted by Deepshikha Sethi
Bengaluru (Bangalore)
1 - 3 yrs
₹4L - ₹10L / yr
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode
Model-View-View-Model (MVVM)
+1 more

As part of the Mobile SDK Engineering team at Flyy, here are some things you can expect:

  • Take ownership and be responsible for what you build - no micromanagement
  • Work with customer success team to enable Flyy customers to adopt Insights-led engagement in different industry sectors like e-Commerce, FinTech, OTT, Social, entertainment, travel, telco, food-tech etc.
  • Explore the latest in topics like Mobile development, SDK, iOS, Android, tvOS various mobile hybrid frameworks and share with the team and more importantly, have fun while you work on scaling Flyy.

 

Skills Required :

  • Minimum 1 years experience in iOS Development
  • Minimum 6 months or 1 year of experience in Native Mobile Development
  • Minimum 6 months or 1 year of experience in React-Native/Flutter framework
  • Should be thorough with different architectures used in Mobile Development
  • In-depth knowledge and understanding of Android/iOS framework:
  • Multithreading concepts
  • Persistent data storage
  • Rest APIs Implementation
  • Should know the internals of the mobile build and distribution processes
  • Ready to learn and develop in any cross-platform frameworks
  • Should be able to capture bottlenecks and improve them without or little supervision
  • Awareness of Secure Development process and practices
  • Awareness on Information Security concepts and Best Practices

Good to Have:

  • Knowledge of other cross-platform frameworks i.e., Cordova, Unity, etc
  • Experience in working and shipping SDKs/plugins
Read more
Edulion
Raunak Rane
Posted by Raunak Rane
Remote only
2 - 7 yrs
₹5L - ₹15L / yr
Fullstack Developer
Mobile App Development
The legal community consists of 1.5 million professionals and counting each day. However, the legal field remains one of the most technologically under-penetrated sectors of today. There are a lot of problems that are faced by lawyers and CA, CS etc.

I am currently building a professional networking platform for legal and paralegal professionals for networking, upskills, seeking jobs and lead generation. The platform is planned after thorough research and survey from the community. 

Who am I?
I am a lawyer of 10 years and an entrepreneur. This is my second venture and my first being an edtech company. I am currently pursuing Entrepreneurship at IIM Calcutta.

What We Are Looking For
  • Bachelor's or master's degree in computer sciences, Engineering, or related field.
  • startup experience preferred
  • Have Entrepreneurial mindset, drive and motivation required to build a company - from early stage to a scaled operation
  • Full-stack and app experience in either android/iOS is preferred.
  • Prior experience of working in a Fast-Paced Startup is preferred
  • Has integrity Strong hands-on attitude and willingness to take on various tasks inside and outside your field of expertise.
  • Excellent communication & team management skills (not required but preferred)
Why You Should Consider Talking To Us
  • It's a 0-1 opportunity where you get to carve out a product grounds up
  • We will, together, solve a big problem
  • There is massive upside on success - and we want to be very fair in creating shared value that translates into real money (we mean equity!)
  • You enjoy working in an environment where hard work, clarity, and respect are valued



Read more
Nimbly Technologies
at Nimbly Technologies
1 video
3 recruiters
Reine S
Posted by Reine S
Remote, Bengaluru (Bangalore)
3 - 8 yrs
Best in industry
skill iconNodeJS (Node.js)
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
skill iconMongoDB
+6 more
We are hiring at Nimbly!

We are looking for Backend Engineers with Javascript nodejs, mongodb expertise.

Please let us know if you are interested and share your cv with us.

About us:
Nimbly is a mobile solution that transforms the manual operational process into one that is digital and much more efficient. Nimbly allows organisations to manage their operation anytime, anywhere. With Nimbly companies can validate visitations, attach live photos and videos, also discover issues and monitor resolution in real-time. In the management level, you have access to data-driven business insights at your fingertips.

We have a very cool tech stack!
Tech Stack: Google Cloud Platform, Front end: Javascript React Typescript, Backend: Javascript node js, Mongo DB, Firebase, Analytics: Google Big query, Sisense. Java and Python are plus.

Come Join us!
Read more
Rahi Systems Pvt Ltd
at Rahi Systems Pvt Ltd
3 recruiters
Shruti Patwari
Posted by Shruti Patwari
Pune
5 - 10 yrs
₹8L - ₹15L / yr
Software Development
Databases
Team Management
MERN Stack
MEAN stack
+2 more

Job Title: Software Development Manager
Job Type: Full – Time 
Location: Pune 
Work Timings – General Shift

Main Job Tasks and Responsibilities
:

  • Provide project management and overall leadership on every aspect of the software and infrastructure
  • Engage in external customer and client discussions at all stages of a project lifecycle as needed, including initial project scoping efforts through development and project presentation.
  • Get involved to provide directions for different projects inclusive of research, development, design, evaluation, testing along with delivery.
  • Supervise architecture planning and lead efforts to develop a technical roadmap for projects.
  • Breakdown the Project stories into Sprints and ensure project completion on time by delegating, monitoring, and mitigating risks.
  • Establish and stimulate software development standards and processes along with best practices.
  • Perform closely with Engineers, Developers, and Product Management throughout the organization.
  • Brainstorming new product development strategies and solutions.
  • Constantly find ways to improve efficiency, introduce automation and smart measures for robust quality.
  • Ensure quality design reviews to meet the customer’s SLA.
  • Supervise resource allocation to assure the attainment of apt business and personnel development goals.
  • Involve in strategic plans to accomplish technical as well as business with leadership chain, team, and customers.
  • Evaluate projects, develop and update schedules plus supervise project status.
  • Collaborate effectively with all team members as well as hold regular team meetings.
  • Provide a safe and healthy environment for the team to develop and grow into highly productive, self-motivated, and competitive intellectuals

Skills and Experience:

Qualifications:

  • BE/B-Tech/MBA in any related field.
  • Experience: 5+ years

Skills:

  • Strong Verbal and Written Communications Skills.
  • Strong Relationship Building Ability with teams at all locations.
  • Ability to work Collaboratively with various Verticals across multiple Geographical Locations.
  • Ability to handle multiple projects simultaneously, efficiently & accurately.
  • Should have technical knowledge of product development over Mobile, desktop, and enterprise infrastructure.
  • Should have the ability to independently manage development from design through testing and deployment.
  • Should have had experience tech stacks like MERN, MEAN, LAMP, or equivalent.
  • UI experience is preferred.
  • 2+ years of application development experience using Cloud technologies.

 

Personal Qualities and Behavior traits:

  • Be a good team worker demonstrating loyalty and commitment to the organization and team members.
  • Good organizational and communication skills and excellent attention to details
  • Interact with individuals to facilitate information and feedback.
Read more
Eduera Solutions
at Eduera Solutions
1 recruiter
Ronak Shah
Posted by Ronak Shah
Mumbai
2 - 5 yrs
₹3L - ₹6L / yr
Business Development
Channel Sales
Presales
Sales
Telesales
Should be good in written and verbal communication. Should be able to work independently. Should be hardworking & eager to learn. Past experience in HR sales is preferable.
Read more
Edutor Technologies India pvt Ltd
Radha Setty
Posted by Radha Setty
Hyderabad
1 - 3 yrs
₹3L - ₹5L / yr
Project Management
Technical Training
Team Management
client management
Test Planning
Job responsibilities  Engage with customers to understand their requirements in detail  Develop and managed the scope of work within a project for large accounts  Guide customers through the process of content onboarding and digitization  Work with the customers to finalize software customization, hardware procurement, and deployment plans  Connect with customer teams to define UI/UX/design of the software and content package  Manage content onboarding process by coordinating with customer and internal teams  Manage the content digitization project by working with all the teams involved  Work with product, content, deployment, and procurement teams to ensure that account related task items are complete  Track task items and follow-up with customer and internal teams  Identify risk items for the project and ensure that mitigation measures are taken up  Raise and track issues related to the project  Define product review mechanism and ensure that teams are adhering to the defined quality standards  Ensure that timelines are met and quality output is delivered  Engage with the customer in product review process and obtain signoff on the final deliverable Preferred qualifications  1 to 3 years of prior work experience in ed-tech or e-learning or software services companies Key interface points  Customer academic and IT teams, Product team, Content team, Delivery Manager Professional attributes  Basic understanding of technology platforms  Project management skills  Knowledge in developing and administering resource plans and budgets.  Strong verbal and written communication skills.  Computer literate, with high level of competence in the use of the Microsoft Office suite of tools, including Microsoft Excel/PowerPoint/Visio/Project.  Full systems development lifecycle experience from requirements gathering through design, testing and deployment Personal attributes  Possess a responsible attitude, tact, patience, and courtesy  Ability to operate under pressure and deliver to demanding deadlines  Achieve results through others  Influence the teams involved to get the work done
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos