Cutshort logo
Global digital transformation solutions provider.  logo
Lead II - Data Engineering -Python - Databricks, PySpark, Python
Global digital transformation solutions provider.
Lead II - Data Engineering -Python - Databricks, PySpark, Python
Peak Hire Solutions's logo

Lead II - Data Engineering -Python - Databricks, PySpark, Python

at Global digital transformation solutions provider.

Agency job
7 - 9 yrs
₹15L - ₹28L / yr
Bengaluru (Bangalore)
Skills
databricks
skill iconPython
SQL
PySpark
skill iconAmazon Web Services (AWS)
ETL
Informatica
Performance tuning
AWS Lambda
Amazon Redshift
Data modeling
CI/CD
skill iconGit
EMR

Role Proficiency:

This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required.


Skill Examples:

  1. Proficiency in SQL Python or other programming languages used for data manipulation.
  2. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.
  3. Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).
  4. Conduct tests on data pipelines and evaluate results against data quality and performance specifications.
  5. Experience in performance tuning.
  6. Experience in data warehouse design and cost improvements.
  7. Apply and optimize data models for efficient storage retrieval and processing of large datasets.
  8. Communicate and explain design/development aspects to customers.
  9. Estimate time and resource requirements for developing/debugging features/components.
  10. Participate in RFP responses and solutioning.
  11. Mentor team members and guide them in relevant upskilling and certification.

 

Knowledge Examples:

  1. Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.
  2. Proficient in SQL for analytics and windowing functions.
  3. Understanding of data schemas and models.
  4. Familiarity with domain-related data.
  5. Knowledge of data warehouse optimization techniques.
  6. Understanding of data security concepts.
  7. Awareness of patterns frameworks and automation practices.


 

Additional Comments:

# of Resources: 22 Role(s): Technical Role Location(s): India Planned Start Date: 1/1/2026 Planned End Date: 6/30/2026

Project Overview:

Role Scope / Deliverables: We are seeking highly skilled Data Engineer with strong experience in Databricks, PySpark, Python, SQL, and AWS to join our data engineering team on or before 1st week of Dec, 2025.

The candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and analytics solutions that drive business insights and operational efficiency.

Design, build, and maintain scalable data pipelines using Databricks and PySpark.

Develop and optimize complex SQL queries for data extraction, transformation, and analysis.

Implement data integration solutions across multiple AWS services (S3, Glue, Lambda, Redshift, EMR, etc.).

Collaborate with analytics, data science, and business teams to deliver clean, reliable, and timely datasets.

Ensure data quality, performance, and reliability across data workflows.

Participate in code reviews, data architecture discussions, and performance optimization initiatives.

Support migration and modernization efforts for legacy data systems to modern cloud-based solutions.


Key Skills:

Hands-on experience with Databricks, PySpark & Python for building ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration (Airflow preferred).

Excellent problem-solving, communication, and collaboration skills.

 

Skills: Databricks, Pyspark & Python, Sql, Aws Services

 

Must-Haves

Python/PySpark (5+ years), SQL (5+ years), Databricks (3+ years), AWS Services (3+ years), ETL tools (Informatica, Glue, DataProc) (3+ years)

Hands-on experience with Databricks, PySpark & Python for ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, Git, and workflow orchestration (Airflow preferred).


******

Notice period - Immediate to 15 days

Location: Bangalore

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Byteridge
at Byteridge
3 recruiters
Keerthana Gracelin
Posted by Keerthana Gracelin
Remote only
15 - 23 yrs
Best in industry
P&L Ownership
Engineering Leadership
Portfolio management
Delivery Management
Organizational Scaling
+2 more

What will you need to be successful in this role?

  • Own end-to-end engineering and delivery for an organisation of ~150–200 people across client-deployed and product-owned engagements.
  • Build and develop the leadership layer of Delivery Managers, Software Development Architects, and Solution Architects.
  • Own P&L across all engagements – revenue, margin, cost, SOW governance, and contract negotiation.
  • Own senior client relationships and lead governance forums (QBRs, steering committees) for top accounts.
  • Drive engineering quality, technical standards, and engineer career development across the organisation.
  • Establish the operating rhythm – weekly delivery review, monthly engineering review, quarterly client governance.
  • Support pre-sales through estimates, proposals, and client pitches, and identify growth opportunities within accounts.
  • 18+ years of total experience spanning engineering and delivery, with 5+ years in senior leadership.
  • Proven track record running an organisation of 100+ engineers with direct P&L responsibility.


Good to have:

  • Experience running both client-deployed (staff augmentation, embedded teams) and product-owned delivery models in one organisation.
  • Technical awareness across Angular, React, .NET, Java, Node.js, Python, AWS, Azure, GCP, Docker, and Kubernetes.
  • Exposure to AI-enabled delivery (RAG, agentic systems, MCP, A2A).
  • Hands-on familiarity with Jira Align, MS Project, or similar portfolio tooling.
  • MBA or equivalent business qualification; relevant certifications a plus (PMP, PgMP, SAFe).


Competencies:

  • Engineering leadership and technical depth – credible with architects and senior engineers on architecture and trade-offs.
  • Strong commercial acumen across P&L ownership, contract governance, and margin management.
  • Excellent communication (written, verbal, presentation), persuasion, and negotiation skills at executive level.
  • Proven ability to coach and develop delivery managers, architects, and senior engineers as a manager-of-managers.
  • Sound judgement under pressure, balancing multiple priorities and stakeholders.
  • A proactive, can-do and can-think approach to organisational change and problem-solving.
  • Excellent academic record – B.E./B.Tech CS/IT with MBA or M.S.


Location: Remote


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Himanshi Gaba
Posted by Himanshi Gaba
Bengaluru (Bangalore)
7 - 10 yrs
Best in industry
skill iconJava
Spring


Role Overview:


We are looking for a Lead Software Engineer with 7-10 years of experience to join our team in Bangalore. The ideal candidate should have strong expertise in financial services, databases, microservices. This role requires a mix of hands-on technical skills, leadership capabilities, and client engagement experience.


Looking for candidates from IIT/NIT/BITS/VIT

Investment Banking Domain Preferred


Key Responsibilities:

  • Technical Leadership: Lead a team of developers, perform code reviews, and ensure high-quality software delivery.
  • Microservices & Databases: Design, develop, and optimize microservices architecture with robust database integrations.
  • Solution Delivery: Drive end-to-end software development, from design to deployment, ensuring on-time and high-quality project completion.
  • Team Collaboration: Mentor junior engineers, provide technical guidance, and foster a culture of innovation and continuous improvement.


Required Skills & Experience:

  • 7-10 years of experience in software development & leadership
  • Expertise in financial services domain.
  • Strong knowledge of databases (SQL, NoSQL) and microservices architecture
  • Excellent client communication skills and ability to manage stakeholder expectations
  • Hands-on experience in designing, building, and deploying scalable enterprise solutions


Why Join Wissen Technology?

  • Work on cutting-edge projects for Fortune 500 financial institutions
  • Be part of an innovation-driven team that values technical excellence and leadership
  • Opportunity to work directly with business and technology leaders
  • Competitive compensation and a dynamic work environment




Read more
Victrix Systems  Labs
at Victrix Systems Labs
1 recruiter
Vijayalaxmi Yadav
Posted by Vijayalaxmi Yadav
Pune
6 - 10 yrs
₹25L - ₹35L / yr
skill iconJava
skill iconSpring Boot
Microservices
Apache Kafka
skill iconElastic Search
+1 more

EDUCATION & EXPERIENCE :

- A professional degree in Computer Science from a reputable institution, backed by a consistent academic record.

- A knack for problem-solving, data structures, and algorithms.

- Proficiency in ElasticSearch.

- 6+ years of hands-on development experience, primarily in building products for large enterprises.

- Exceptional communication skills.

- Mastery in Java programming; familiarity with Python is a plus.- Experience with Spring Boot.

- Practical knowledge of one or more cloud-based technologies (e.g., ElasticSearch, Storm, Hazelcast, MongoDB, Ceph, Kafka) is highly desirable.

- Expertise in building concurrent and/or parallelized, highly performant scalable applications.

- A track record of identifying and addressing complex issues in scalable deployments.

- Exposure to Service-Oriented Architecture (SOA) and Test-Driven Development (TDD) is an added advantage.


ROLES & RESPONSIBILITIES :

- Dive deep into technical aspects (Analysis, Design & Implementation) as required.

- Take complete ownership of features within the product.

- Engage in debates and detailed discussions about functional and non-functional requirements with our Product Management team.

- Collaborate with the team to design solutions, seeking stakeholder input before implementation.

- Create essential artifacts such as functional specifications and detailed designs for your assigned features.

- Implement intricate features with an unwavering commitment to quality, following the Test- Driven Development (TDD) process.

- Maintain open lines of communication, promptly reporting risks and progress to your supervising manager.

- Share your expertise and mentor team members.

- Provide support by troubleshooting and creating Root Cause Analysis (RCA) for production issues, subsequently working on short-term and long-term solutions.

Read more
Janovis Infotech
at Janovis Infotech
1 recruiter
Agency job
via Janovis Infotech by Kishan Patel
Ahmedabad
1 - 2 yrs
₹3.5L - ₹4.5L / yr
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconHTML/CSS
skill iconJavascript
skill iconRedux/Flux
-1 to 2 year Experience in React.js & Node Js making use of the tools described below
-Previous experience working as a react.js developer.  
-Javascript proficiency,
-Thorough understanding of React.js & Node js principles
-Experience with popular Reactjs workflows, Redux
-Experience with data structure libraries
-Familiarity with Restful Apis
-Familiarity with benchmarking and optimization
-Familiarity with front-end build pipeline & tools
-Ability to understand business requirements and translate them into technical requirements
-Agile methodology and scrum.
-Excellent troubleshooting skills.
-Good project management skills
-In-depth knowledge of JavaScript, CSS, HTML, and front-end languages.
Read more
wwwemotcoin
at wwwemotcoin
1 recruiter
Shiv Garg
Posted by Shiv Garg
Bengaluru (Bangalore)
2 - 3 yrs
₹3L - ₹5L / yr
skill iconJavascript
skill iconPython
skill iconGit
skill iconAmazon Web Services (AWS)
Internet of Things (IOT)
+6 more

Full-stack Developer 

We are looking  for 2-3 Year experienced person for our IoT Division based out of Bangalore. Option for Work from Home is also available.  


Responsibilities

  • Design and implementation of the overall web architecture
  • Design and deployment of our database, associated areas such as database design /management and DevOps.
  • Ensuring the entire stack is designed and built for speed and scalability
  • Design and construction of our API-Fast, REST.
  • Integrating our front-end UI with the constructed API.
  • Design and implementation of continuous integration and deployment
  • Knowledge of JSON and PostgreSQL support for JSON.
  • Creating a DB instance running PostgreSQL with the AWS Management Console.
  • Knowledge of Redis cache.

Skills

  • Writing HTML, CSS, and JavaScript/jQuery
  • A relevant back-end programming language e.g., Python or JavaScript.
  • Server management and deployment for the relevant environment
  • Experience implementing testing platforms and unit tests
  • Proficiency with Git.
  • Appreciation for clean and well documented code.

 

Keywords: #AWS #EC2 #Python #Psql #Django #Docker #Redis #Kafka.

Read more
Moonraft Innovation Labs
at Moonraft Innovation Labs
35 recruiters
Sreesha Thoprath
Posted by Sreesha Thoprath
Bengaluru (Bangalore)
0 - 1 yrs
₹2L - ₹4L / yr
Data Structures
Algorithms
Logical Reasoning
Analytical Skills
Moonraft (www.moonraft.com) is a new age techno-creative company focusing on Experience Engineering and consumer based products. Moonraft is a vehicle for innovation; to go beyond. Innovation, to us, means market creation. We strive to conceive and develop product and service ideas with potential to create markets. About Moonraft: a) Founded by experienced Industry veterans (with more than 15 years experience), we are a company focusing on latest technologies like social media, mobile technologies, latest User experience technologies etc. The company focuses on Technology, Design and Content b) We are on the bleeding edge of latest technologies like Android, IOS, HTML 5, CSS3, Jquery, Text Analytics, etc. and savvy about open source technologies c) We have an open, transparent and performance oriented culture d) We offer both services and products. Employees have an opportunity to work on either, based on their skills and interests e) We work purely on development projects, no support or maintenance
Read more
The Dynamic brand is passionate about games. (G1)
The Dynamic brand is passionate about games. (G1)
Agency job
via Multi Recruit by Ayub Pasha
Noida, NCR (Delhi | Gurgaon | Noida)
3 - 5 yrs
₹15L - ₹18L / yr
DevOps
skill iconKubernetes
skill iconDocker
skill iconNodeJS (Node.js)
skill iconPython
+7 more
  • Define and document best practices and strategies regarding application deployment and infrastructure maintenance.
  • Ensure limited system failure and increase up-time and availability of the various company apps.
  • Understand the current application infrastructure and strive for making it better.
  • Automate infrastructure and develop tools and processes to improve the customer experience and reduce support time.
  • Work closely with a team of developers and solution strategists to develop, deploy and troubleshoot the deployment and infrastructure issues.
  • Manage full application stacks from the OS through custom applications using Amazon cloud-based computing environments.
  • Set up a monitoring stack.
  • Implement the application’s CI/CD pipeline using the AWS stack. Increasingly automate and improve the testing plans and development workflows and tools.
  • Work closely with the engineers to design networks, systems, and storage environments that effectively reflect business needs, security requirements, and service level requirements.
  • Manage a continuous integration/continuous deployment methodology for the server-based technologies.
  • Proficient in leveraging CI and CD tools to automate testing and deployment. Experience working in an Agile, fast-paced, DevOps environment.
  • Support internal and external customers on multiple platforms.
  • First point of contact for handling customer issues, providing guidance and recommendations to increase efficiency and reduce customer incidents.
  • Learn on the job and explore new technologies with little supervision.
  • In addition to providing customer support, will be responsible for helping build tools and processes necessary for excellent customer outcomes.

Skills:

  • Experience with the core AWS services, plus the specifics mentioned in this job description.
  • Experience working with at least one of the following languages: Node.js, Python, PHP, Ruby, Kotlin or Java.
  • Proficient with Git and Git workflows and hosted enterprise Git solutions like GitHub.
  • Ability to troubleshoot distributed systems.
  • Experience with. AWS EKS Kubernetes infrastructure setup.
  • Experience creating Cloud Formation Template to create Auto Scaling Groups, Route 53, DNS, back-end database, Elastic load balancer, VPCs, Subnets, Security Groups, Cloud Watch, S3, IAM roles, RDS DB instances, and to provide those instances and configure those resources to work together reducing the manual effort.
  • Experience in deploying and monitoring microservices on Kubernetes, AWS ECS, and AWS EKS
  • Security aware and ensures that all systems are security standards-compliant.
  • Good background in Linux/Unix administration.
  • Experience with building or maintaining cloud-native applications.
  • Minimum 3-5 years of cloud development experience, preferably AWS
  • Experience with CI/CD tools like Jenkins preferred.
  • Good analytical and communication skills
  • Bachelor’s Degree in Computer Science, Engineering or a related technical discipline
Read more
Volks Consulting
at Volks Consulting
18 recruiters
Priyanka Singh
Posted by Priyanka Singh
Remote, Bengaluru (Bangalore)
1 - 4 yrs
₹4L - ₹6L / yr
Business Development
Sales
Lead Generation

PRIMARY ROLE:

The Senior Associate - Business Development will focus on customer acquisition, lead generation, and prospect management, as this role will garner and meet with potential clients. The business development executive will be responsible to research client business referrals, network, and web leads; provide prospective customers/clients with all services offered and additional presentations as needed, and work with clients to create solutions for their needs and consult throughout the sales process. Must be energetic, well-spoken, and eager to close sales and increase revenue.

 

WHAT YOU'LL DO: 

·      Develop a growth strategy focused both on financial gain and customer satisfaction

·      Conduct research to identify new markets and customer needs

·      Arrange business meetings with prospective clients

·      Promote the company’s products/services addressing or predicting clients’ objectives

·      Prepare sales contracts ensuring adherence to law-established rules and guidelines

·      Keep records of sales, revenue, invoices etc.

·      Provide trustworthy feedback and after-sales support

·      Build long-term relationships with new and existing customers

·      Develop entry level staff into valuable salespeople

 

WHAT WE ARE LOOKING FOR:

·      Experience with lead generation and prospect management in the field of HR Services.

·      Excellent verbal and written communication skills; the ability to call, connect, and interact with potential customers

·      Persuasive and goal-oriented

·      Possesses an energetic, outgoing, and friendly demeanour

·      Able to professionally and confidently communicate with C-Level Executives

·      Bachelor’s degree or equivalent

·      1+ years of cold calling experience; previous experience in inside sales, or related sales experience; knowledge of sales process from initiation to close

·      Excellent analytical and time-management skills

·      Demonstrated and proven sales results

·      Ability to work independently or as an active member of a team

Read more
Technix Infotech
at Technix Infotech
1 recruiter
Nirbhay Tripathi
Posted by Nirbhay Tripathi
Noida, NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹1L - ₹3L / yr
Content Writing
Social Media Marketing (SMM)
Community Management
Viral Marketing
Web Analytics
+2 more

Job Summary: --

  • Should be fluent in English (Written & Verbal)
  • Create high-quality content
  • Create and Execute Social Media strategy and roadmap.
  • Proficient in handling Social Media platforms (Facebook, Twitter, Instagram, Linkedin, G+, Youtube)
  • Interact with Followers daily
  • Well versed with various KPIs, Reports.
  • Well versed with latest Social Media Tools and Trends
  • Must be Creative Thinker, Detail Oriented, Smart & Hardworking
  • Responsibilities and Duties: --
  • Must be able to manage Multiple Brand's Pages
  • Able to build trending content for social media
  • Use of Social Media monitoring tools (Hootsuite, Instagram followers, Crowdfire, etc)- Daily, Weekly, and Monthly Reporting
  • Goal to increase the number of followers, brand awareness, and website visitors- Should be detailed focused.

Required Experience, Skills, and Qualifications: -
- Handling Social Media platforms, Able to build trending content for social media, Social Media monitoring tools.
Benefits: -
- Fast Growth
- Metro Connectivity (Walking Distance from Noida sec 15 or sec 16 Metro)
- Friendly Culture
- Minimum 1 Year Contract

Read more
Bitpod
at Bitpod
2 recruiters
Bitpod Technology
Posted by Bitpod Technology
Remote, Hyderabad
1 - 8 yrs
₹4L - ₹16L / yr
skill iconJavascript
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconKubernetes
+1 more
Skills Required:1+ years of in-depth experience in JavaScript.UI: Good expertise in ReactJS, Redux, Mobx. Experience in React-Native is a plus.NodeJS: Strong expertise in Express, Passport. Experience in Loopback is a plus.NoSQL: Strong expertise in MongoDB and Redis. Experience in other NoSQLs like PouchDB, Cassandra is a plus.Tooling: Bundlers: Strong experience in configuring and managing Webpack with Babel plugins.TDD: Good experience in setting up and maintaining TDD frameworks like Jest, Mocha, Chai, Karma.Concepts: In-depth understanding of designing and implementing Rest API. Familiarity with OpenID/OAuth 2.0 flows, in context of integrating nodejs applications with it. Prior work with compilers, language processors, ASTs is a definite plus.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos