Cutshort logo
Global digital transformation solutions provider.  logo
Lead II - Data Engineering -Python - Databricks, PySpark, Python
Global digital transformation solutions provider.
Lead II - Data Engineering -Python - Databricks, PySpark, Python
Global digital transformation solutions provider. 's logo

Lead II - Data Engineering -Python - Databricks, PySpark, Python

at Global digital transformation solutions provider.

Agency job
7 - 9 yrs
₹15L - ₹28L / yr
Bengaluru (Bangalore)
Skills
databricks
skill iconPython
SQL
PySpark
skill iconAmazon Web Services (AWS)
ETL
Informatica
Performance tuning
AWS Lambda
Amazon Redshift
Data modeling
CI/CD
skill iconGit
EMR

Role Proficiency:

This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required.


Skill Examples:

  1. Proficiency in SQL Python or other programming languages used for data manipulation.
  2. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.
  3. Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).
  4. Conduct tests on data pipelines and evaluate results against data quality and performance specifications.
  5. Experience in performance tuning.
  6. Experience in data warehouse design and cost improvements.
  7. Apply and optimize data models for efficient storage retrieval and processing of large datasets.
  8. Communicate and explain design/development aspects to customers.
  9. Estimate time and resource requirements for developing/debugging features/components.
  10. Participate in RFP responses and solutioning.
  11. Mentor team members and guide them in relevant upskilling and certification.

 

Knowledge Examples:

  1. Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.
  2. Proficient in SQL for analytics and windowing functions.
  3. Understanding of data schemas and models.
  4. Familiarity with domain-related data.
  5. Knowledge of data warehouse optimization techniques.
  6. Understanding of data security concepts.
  7. Awareness of patterns frameworks and automation practices.


 

Additional Comments:

# of Resources: 22 Role(s): Technical Role Location(s): India Planned Start Date: 1/1/2026 Planned End Date: 6/30/2026

Project Overview:

Role Scope / Deliverables: We are seeking highly skilled Data Engineer with strong experience in Databricks, PySpark, Python, SQL, and AWS to join our data engineering team on or before 1st week of Dec, 2025.

The candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and analytics solutions that drive business insights and operational efficiency.

Design, build, and maintain scalable data pipelines using Databricks and PySpark.

Develop and optimize complex SQL queries for data extraction, transformation, and analysis.

Implement data integration solutions across multiple AWS services (S3, Glue, Lambda, Redshift, EMR, etc.).

Collaborate with analytics, data science, and business teams to deliver clean, reliable, and timely datasets.

Ensure data quality, performance, and reliability across data workflows.

Participate in code reviews, data architecture discussions, and performance optimization initiatives.

Support migration and modernization efforts for legacy data systems to modern cloud-based solutions.


Key Skills:

Hands-on experience with Databricks, PySpark & Python for building ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration (Airflow preferred).

Excellent problem-solving, communication, and collaboration skills.

 

Skills: Databricks, Pyspark & Python, Sql, Aws Services

 

Must-Haves

Python/PySpark (5+ years), SQL (5+ years), Databricks (3+ years), AWS Services (3+ years), ETL tools (Informatica, Glue, DataProc) (3+ years)

Hands-on experience with Databricks, PySpark & Python for ETL/ELT pipelines.

Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).

Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).

Experience with data modeling, schema design, and performance optimization.

Familiarity with CI/CD pipelines, Git, and workflow orchestration (Airflow preferred).


******

Notice period - Immediate to 15 days

Location: Bangalore

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Intineri infosol Pvt Ltd
at Intineri infosol Pvt Ltd
2 candid answers
Shivani Pandey
Posted by Shivani Pandey
Remote only
4 - 6 yrs
₹5L - ₹12L / yr
skill iconJavascript
Glide Script
JSON
SQL
ServiceNow
+3 more

Role Overview

 

We are seeking a ServiceNow Product Owner with deep expertise in ServiceNow modules (CSM, ITSM, HRSD)

and strong scripting and data-handling skills.

 

This role focuses on translating real enterprise workflows into structured, data-driven AI training tasks, helping improve reasoning and understanding within AI systems. It is not a platform configuration or app development role — instead, it blends functional ServiceNow knowledge, prompt engineering, and data design to build the next generation of intelligent enterprise models.

 

Key Responsibilities

 

·    Define decision frameworks and realistic scenarios for AI reinforcement learning based on ServiceNow workflows.

·    Design scenario-driven tasks mirroring ServiceNow processes like case handling, SLA tracking, and IT incident management.

·    Develop and validate structured data tasks in JSON, ensuring accuracy and clarity.

·    Write natural language instructions aligned with ServiceNow’s business logic and workflows.

·    Use SQL queries for validation and quality checks of task data.

·    Apply prompt engineering techniques to guide model reasoning.

·    Collaborate with peers to expand and document cross-domain scenarios (CSM, ITSM, HRSD).

·    Create and maintain documentation of scenario patterns and best practices.

 

Required Experience

 

·    4–6 years of experience with ServiceNow (CSM, ITSM, HRSD).

·    Deep understanding of cases, incidents, requests, SLAs, and knowledge management processes.

·    Proven ability to design realistic enterprise scenarios mapping to ServiceNow operations.

·    Exposure to AI model training workflows or structured data design is a plus.

 

Preferred Qualifications

 

·    ServiceNow Certified System Administrator (CSA)

·    ServiceNow Certified Implementation Specialist (CIS-ITSM / CSM / HRSD)

·    Exposure to AI/ML workflows or model training data preparation.

·    Excellent written and verbal communication skills, with client-facing 


Mandatory Skills: Scripting (Javascript, Glide Script), JSON Handling, SQL, Service Now Modules (ITSM, CSM, HRSD) and Prompt Engineering.

Read more
Quantum BSO and Tech Pvt Ltd
Arshiya Shaik
Posted by Arshiya Shaik
Bengaluru (Bangalore)
3 - 5 yrs
₹3L - ₹7L / yr
Search Engine Optimization (SEO)
Content Writing

Job Description for Digital Marketing Executive

About Quantum:

 We are a product innovation company that supports the Transportation and Shipping industries to overcome their business challenges and be leaders in Digital Transformation. Our strength is the in-depth knowledge we hold of the Transportation and Shipping landscape. Our journey begun when we started simplifying the complexities of these businesses as far back as 2003. At the core, we aspire to impact great changes in the Transportation business through our inventions & technology. We are based in Bangalore.

Job role:

·        Job role: Digital Marketing Executive

·        Educational qualification: BBA/BBM/MBA

·        Age limit: 28 to 32 years

·        Job location: Koramangala, Bangalore. We are doing work from office model

·        Years of experience: 3 to 6 years

 

What you will be doing:

·        Responsible for formulation and execution of the company’s Digital Marketing Strategy

·        Creation and management of website

·        Independently managing all digital marketing activities

·        Set up and management of Linked in and twitter accounts

·        Writing blogs and content on digital forum to ensure visibility

·        Responsible to develop and implement the Online Marketing and Brand Positioning strategies

·        Create key reporting and performance indicators based on business requirements

·        Brand management on the digital forum

 

Core skill required:

·        Social Media Management

·        Search Engine Optimization

·        Social Media Calendar Management

·        Brand Reputation Management

·        Google Funnel Creation and Optimization

·        Email Marketing

·        Programmatic Advertising

·        Google AdWords

·        Meta Advertising

·        LinkedIn Advertising

·        Brand Management

·        Off page SEO & On-Page SEO Analysis, Technical SEO

·        Google Analytics

·        Advanced Web Page Ranking

·        Google Webmasters

·        Google Search Console

·        Google Trends

·        Blog Management/Content Generation

 

Primary skills:

·        3+ years of experience as a Digital Marketing Professional

·        Understanding the importance of the Website

·        Experience in Email marketing and carry it to the digital forum

·        Social media marketing - visibility

·        Experience in branding

·        Must understand page optimization and off page optimization

·        Understand the value of Search engine optimization but as a complementary skill.

·        Blog writing and Content generation

 

Secondary skills:

·        Knowledge on Google certification and Google analytics, Google AdWords

·         Setting up tracking systems for marketing campaigns and online activities

·        Experience in Website maintenance and press releases

·        Latest marketing techniques


Get in Touch or apply?

At Quantum, as much as our clients are important to us, our internal team is very valuable to us, if you invest in us, we will invest back in you through learning, recognition & an opportunity to grow. Be a part of the team that innovates for the future.

 

Our Social Media presence:

Website: www.quantumbso.com

LinkedIn: https://www.linkedin.com/company/quantumbso/

 

Company location:

Quantum BSO and Tech Pvt. Ltd, 3rd Floor, Ahad Pinnacle, #80, 5th Main, 2nd Cross, 5th Block,, Koramangala Industrial Area, Bengaluru, Karnataka 560095.

 

 

Read more
Avegen Health
Zeba Ali
Posted by Zeba Ali
Pune
3 - 6 yrs
₹4L - ₹8L / yr
Software Testing (QA)
Test Automation (QA)
Appium
Selenium
skill iconPostman
+5 more

Position Summary


We are seeking an experienced Senior Test Engineer to ensure the quality and reliability of our full-stack mobile and web applications built with React Native and Ruby on Rails. In this role, you will work closely with cross-functional teams to design and execute testing strategies, develop automation frameworks using Selenium and BrowserStack, and contribute to the continuous improvement of our QA processes.


Key Responsibilities


1. Testing Strategy and Execution:

• Develop and execute comprehensive test plans for mobile and web applications.

• Conduct functional, regression, performance, compatibility, and security testing.

• Collaborate with developers, product managers, and stakeholders to clarify requirements and ensure test coverage.

2. Automation Frameworks and Tools:

• Build and maintain test automation frameworks for web and mobile applications using Selenium and BrowserStack.

• Create and maintain automated test scripts for cross-browser and cross-device testing.

• Integrate automated tests into CI/CD pipelines using tools like Jenkins, GitHub Actions.


3. Mobile and Web Application Testing:

• Perform testing of React Native mobile applications across various devices and platforms using BrowserStack.

• Validate web application functionality across multiple browsers and screen resolutions with Selenium.

• Ensure the performance and responsiveness of applications on both mobile and web platforms.


4. Defect Management and Reporting:

• Log and track defects in tools like JIRA , working closely with developers for resolution.

• Provide detailed test reports and feedback to stakeholders, highlighting risks and improvement opportunities.


5. Performance and Load Testing:

• Execute backend performance and load testing for Ruby on Rails applications using tools like JMeter.

• Analyze application performance metrics to identify potential bottlenecks.


6. Process Improvement:

• Actively contribute to improving QA processes and adopting best practices for testing and automation.

• Participate in Agile/Scrum ceremonies, ensuring quality is integrated into each sprint cycle.

• Help with internal and external audits inline with Quality Management System.

7. Documentation and Knowledge Sharing:

• Maintain detailed documentation of test cases, automation scripts, and testing processes.

• Share insights and technical knowledge with team members to support their growth.


Qualifications and Skills


1. Technical Expertise:

• Hands-on experience in testing mobile applications built with React Native.

• Experience in backend testing for Ruby on Rails, including API testing using tools like Postman or Swagger.

• Proficiency with automation frameworks such as Selenium and tools like BrowserStack.


2. Automation Skills:

• Strong skills in developing and executing automated test cases for web and mobile applications.

• Knowledge of programming languages like Java, JavaScript, or Python for automation scripting.

• Experience integrating test automation into CI/CD workflows.


3. Problem-Solving and Collaboration:

• Ability to analyze complex systems, troubleshoot issues, and propose solutions.

• Strong collaboration skills with the ability to work closely with cross-functional teams.


4. Industry Knowledge:

• Familiarity with Agile methodologies and test-driven development practices.

• Understanding of best practices in security, performance, and accessibility testing.

• Exposure to Health Tech and related domains is a plus.

• Exposure to start up environment is a plus.


5. Preferred Skills:

• Experience with cloud environments (e.g., AWS, Azure, GCP) for testing and deployment.

• Knowledge of SQL/NoSQL databases for database validation and testing.

• Awareness of mobile app deployment processes for App Store and Google Play.


Education and Experience


• Bachelor’s degree in Computer Science, Software Engineering, or a related field.

• 4+ years of QA/testing experience with expertise in mobile and web application testing.

• Hands-on experience with React Native and Ruby on Rails applications is highly preferred.


Benefits


• Competitive salary and performance-based bonuses.

• Comprehensive health, dental, and vision insurance.

• Flexible working hours and remote work opportunities.

• Professional development and training reimbursement.

Read more
k4 Media  Technologies
Nikita Bhaisora
Posted by Nikita Bhaisora
Jaipur
0 - 2 yrs
₹2L - ₹3L / yr
Search Engine Optimization (SEO)
English Proficiency
Content Writing
Creative Writing

1. Providing SEO optimized unique and plagiarism-free content

2. Ensuring the quality of content assigned to you

3. Managing the work-from-home content writers and reviewing & editing articles written by them

4. Publishing content on our websites and mobile apps

Read more
Concentric AI
at Concentric AI
7 candid answers
1 product
Agency job
via Multi Recruit by Chandra Kanth
Pune
5 - 10 yrs
₹1L - ₹15L / yr
skill iconJava
J2EE
NOSQL Databases
RESTful APIs
skill iconAmazon Web Services (AWS)
+1 more

• Design, develop, code and test the solution

• Experience working with large datasets and NoSQL database technologies (e.g. Cassandra, ES) 

• 5-10 yrs of industry experience

• Energetic self-starter, with a desire to work in a startup environment

• Proficient in advanced Java programming skills

• Expert in Application development cloud/on premise end to end. Middle layer, DB layer.

• Nice to have understanding on MQ (e.g. Kafka)

• Good hands on in Complex Event Processing systems

• Solved scale and performance issues while dealing with huge sets of data. Pre compute or data aggregation frameworks to achieve good response time

• Experience working with large datasets and NoSQL database technologies (e.g. Cassandra, ES)

• Experience of debugging applications running on Unix like systems (e.g. Ubuntu, CentOS)

• Experience developing RESTful APIs for complex data sets

• Knowledge of container based development & deployment (e.g. Dockers, K8s)

• Expertise in software security domain, a plus



Read more
TEANSOFT
at TEANSOFT
4 recruiters
rakesh babu
Posted by rakesh babu
Remote, Delhi, Gurugram (Gurgaon), Noida, Ghaziabad, Faridabad
1 - 3 yrs
₹3L - ₹5L / yr
Recruitment
Recruitment/Talent Acquisition
Sourcing
Talent management
Team Management
  • You will be responsible for the entire recruitment process. You will work in sourcing the right candidate for the right job using multiple sources - social, online, offline, etc. plus College Campuses.
  • You will plan, schedule, and oversee all our interviews and ensure it follows a process and schedule.
  • You will create talent pipelines for our immediate and future requirements.
  • Acquire potential candidates through various online channels (LinkedIn, Indeed, Glassdoor, Naukri, etc.) plus Engineering College Campuses
  • Proactively promote and lead activities for adoption of company values for a positive office culture.
  • Be a thought partner to the leadership team in developing and maintaining a strong culture
  • Provide useful data to help guide decision making, and allow the company to scale effectively and efficiently.
  • Develop, promote, and implement opportunities for skills and professional development of team members.
  • info at teansoft.com your profile
Read more
Catalyst IQ
at Catalyst IQ
6 recruiters
Sidharth Maholia
Posted by Sidharth Maholia
Remote, Bengaluru (Bangalore)
5 - 7 yrs
₹20L - ₹45L / yr
Product Management
Product Manager
Product Strategy
Product design
Entrepreneurship
Role and Responsibilities

• Develop a deep understanding of the user, both existing and potential.
• Develop a thorough understanding of the digital video market segments, and continually assess the landscape and emerging industry trends.
• Partner with key stakeholders to define the product vision, strategy, roadmap, and supporting metrics required to deliver and enhance a best-in-class digital video user experience.

• Own end-to-end development starting from business case approval from stakeholders, leading to defining detailed product requirements documents, working with tech to build functionalities, and partnering with the team to own and drive launch/growth with robust go-to-market plans.
• Work cross-functionally with data science, engineering, design, marketing, business development, legal, finance, customer service, and operations teams to deliver on the product roadmap and business goals.

Basic Qualifications:
• 4+ years of data-driven product management work experience performing relevant, innovative, product management job functions while partnering closely with software development teams.
• Proven ability to rally a broad range of cross-functional stakeholders to turn a big vision into reality.
• Prior experience in working with designers, engineers, and business leaders to generate buy-in for the product in the direction you are setting.
• Technical experience in developing, delivering, and executing on complex distributed software systems at scale.
• A combination of business and technical depth with the ability to dive deep with senior technical leaders to understand architecture concerns, address objections and gather detailed technical requirements.
• Ability to think strategically and execute methodically.
• Excellent analytical abilities and oral/written communication skills.
• Passion for understanding users and their behavior, particularly with regards to the digital video space.
• Direct experience defining products and roadmaps which deliver simple, immersive user experiences while dealing with underlying complex technical requirements.

Preferred Qualifications:
• Experience delivering digital streaming media and/or in any other consumer subscription services business.
• MBA or advanced degree in a related field
Read more
NanoRocks Innovation
at NanoRocks Innovation
2 recruiters
Sahil Asija
Posted by Sahil Asija
Remote only
3 - 5 yrs
₹3L - ₹5L / yr
Business Development

The ideal candidate will have strong motivation, drive, client focus and people skills who can lead from the front and will relish playing a key role in achieving our new growth targets. 

 

Responsibilities

  • Build, inspire and run a sales team
  • Meet ambitious but realistic sales targets critical to envisaged company growth
  • Keep track of and respond quickly to market developments
  • Help to open-up and grow new income streams and take part in strategy development
  • Work with editorial to customise products for clients

 

Qualifications

  • 3+ years' of sales experience
  • Sales management experience
  • High level of competence in telephone sales
  • Excellent verbal and written communication skills with ability to communicate effortlessly with senior post holders
Read more
QAI
at QAI
1 video
1 recruiter
manasa rao
Posted by manasa rao
Bengaluru (Bangalore)
4 - 8 yrs
₹16L - ₹20L / yr
Business Development
Innovation
Business Analysis
We are looking for a Business Development Manager for or Innovation practice.The responsibilities shall encompass overall responsibility for sales, market tracking, engagement and closure in a designated territory for various QAI and QGlue offerings. Broadly the responsibilities would include: Business development/ sales.- Key Account Management- Create and service new and existing accounts, geographic areas and lines of business.- Conduct market research and competitor analysis to identify opportunities for increasing sales.- Presales Strategies for client acquisition and closure.- Seeking and Nurturing Partnerships & Alliances.- Make proposals, demonstrations & presentations to corporate clients.- Responding to RFPs, RFIs, RFQs.You are a perfect fit if- You are a self-driven, ambitious and have a go-getter attitude.- Have 3+ years of relevant experience.- Have exposure and understanding of Design and Innovation space.- Have premier institute education.- Are willing to travel.- Have experience in Solution selling and Key account management for enterprise accounts- Global cultural sensitivity and exposure will be an added advantageAbout the Company:Promoted by QAI (a 30 year-old transnational consulting organization), QGLUE brings a unique design and innovation-led, human-centered approach to building products, services, and businesses in today's - experience economy- making future living better with happier people.QGLUE's service design, design research practice delivers solutions for customers worldwide. It has a lean, agile approach to deliver real customer value by combining analytics, process modeling, and simulation with human-centered design.Website: http://www.q-glue.com
Read more
Kahuna Systems
at Kahuna Systems
1 recruiter
Ketaki Joshi
Posted by Ketaki Joshi
Pune
1 - 3 yrs
₹0L - ₹1L / yr
Application Developer
skill iconJava
skill iconHTML/CSS
A company which helps to explore. Good environment to work.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos