
Lead II - Data Engineering -Python - Databricks, PySpark, Python
at Global digital transformation solutions provider.
Role Proficiency:
This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required.
Skill Examples:
- Proficiency in SQL Python or other programming languages used for data manipulation.
- Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.
- Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).
- Conduct tests on data pipelines and evaluate results against data quality and performance specifications.
- Experience in performance tuning.
- Experience in data warehouse design and cost improvements.
- Apply and optimize data models for efficient storage retrieval and processing of large datasets.
- Communicate and explain design/development aspects to customers.
- Estimate time and resource requirements for developing/debugging features/components.
- Participate in RFP responses and solutioning.
- Mentor team members and guide them in relevant upskilling and certification.
Knowledge Examples:
- Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.
- Proficient in SQL for analytics and windowing functions.
- Understanding of data schemas and models.
- Familiarity with domain-related data.
- Knowledge of data warehouse optimization techniques.
- Understanding of data security concepts.
- Awareness of patterns frameworks and automation practices.
Additional Comments:
# of Resources: 22 Role(s): Technical Role Location(s): India Planned Start Date: 1/1/2026 Planned End Date: 6/30/2026
Project Overview:
Role Scope / Deliverables: We are seeking highly skilled Data Engineer with strong experience in Databricks, PySpark, Python, SQL, and AWS to join our data engineering team on or before 1st week of Dec, 2025.
The candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and analytics solutions that drive business insights and operational efficiency.
Design, build, and maintain scalable data pipelines using Databricks and PySpark.
Develop and optimize complex SQL queries for data extraction, transformation, and analysis.
Implement data integration solutions across multiple AWS services (S3, Glue, Lambda, Redshift, EMR, etc.).
Collaborate with analytics, data science, and business teams to deliver clean, reliable, and timely datasets.
Ensure data quality, performance, and reliability across data workflows.
Participate in code reviews, data architecture discussions, and performance optimization initiatives.
Support migration and modernization efforts for legacy data systems to modern cloud-based solutions.
Key Skills:
Hands-on experience with Databricks, PySpark & Python for building ETL/ELT pipelines.
Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).
Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).
Experience with data modeling, schema design, and performance optimization.
Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration (Airflow preferred).
Excellent problem-solving, communication, and collaboration skills.
Skills: Databricks, Pyspark & Python, Sql, Aws Services
Must-Haves
Python/PySpark (5+ years), SQL (5+ years), Databricks (3+ years), AWS Services (3+ years), ETL tools (Informatica, Glue, DataProc) (3+ years)
Hands-on experience with Databricks, PySpark & Python for ETL/ELT pipelines.
Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).
Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).
Experience with data modeling, schema design, and performance optimization.
Familiarity with CI/CD pipelines, Git, and workflow orchestration (Airflow preferred).
******
Notice period - Immediate to 15 days
Location: Bangalore

Similar jobs
Job Description:
Role: Senior Backend Developer
Mode of work: WFO
Supercharge Your Career as a Senior Backend Developer at Technoidentity!
Are you ready to solve people challenges that fuel business growth? At Technoidentity, we’re a Data+AI product engineering company building cutting-edge solutions in the FinTech domain for over 13 years—and we’re expanding globally. It’s the perfect time to join our team of tech innovators and leave your mark!
What’s in it for You?
We are looking for a highly motivated Senior Backend Developer with 4-6 years of experience to join our team. The ideal candidate will have strong backend development expertise, a deep understanding of distributed systems, and a high sense of ownership. This role requires working independently on POCs and projects while also mentoring junior team members and enabling scalable delivery.
What Will You Be Doing?
- Design, develop, and maintain scalable backend systems and services.
- Work independently on project implementations and backend solution development.
- Implement distributed architecture design patterns to build reliable and high-performance systems.
- Collaborate with cross-functional teams to deliver robust backend solutions.
- Guide and mentor junior developers, ensuring quality implementation and adherence to best practices.
- Participate in system design discussions, code reviews, and technical decision-making.
- Ensure high ownership in delivering solutions aligned with project timelines and goals.
What Makes You the Perfect Fit?
- 4-6 years of backend development experience with strong expertise in Java or Go,
- Hands-on exposure to distributed systems, and solid knowledge of PL/SQL, with the ability to work independently and take high ownership of deliverables.
- Strong problem-solving and critical thinking abilities.
- Experience working with distributed systems and architecture design patterns.
- Strong database development skills with PL/SQL.
- Excellent team coordination and collaboration skills.
- High sense of ownership, accountability, and commitment towards project delivery.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related technical field is required.
Good to Have Skills
- Exposure to Cloud platforms (AWS or GCP).
- Understanding of Frontend technologies or DevOps practices.
- Experience with workflow orchestration tools such as Temporal or similar platforms.
Work Requirements:
- Willingness to work in US or flexible shift timings based on project requirements
- Ability to work independently on POCs/projects and help scale additional pods of work
- Guide and direct junior team members to ensure proper implementation
Technical Assistant
Location: Bengaluru ( Koramangala & Bommasandra)
About Us:
Rekise Marine is a startup focused on sustainably enhancing the utility of oceans through autonomous robotic infrastructure. Our efforts center on developing advanced autonomous technology for the maritime industry, serving both defense and commercial sectors globally. We specialize in creating autonomous vessels both surface and underwater as well as autonomous port infrastructure. Currently, we are building the flagship autonomous platform of the Indian Navy.
About the role:
We are currently seeking a talented individual with an ITI/Diploma or Engineering Degree in Mechanical/Electrical and having strong technical and administrative skills. In this role, you'll play a crucial part in the development process of our unmanned marine vessels, ensuring highest performance and reliability standards.
Key Responsibilities:
- Provide technical support and assistance in product development and maintenance.
- Assist in testing, troubleshooting, and quality control.
- Handle procurements and inventory management.
- Perform administrative tasks such as filing and coordinating with our clients.
- Maintain a clean/organised work environment, ensuring safety and efficiency.
Requirements:
- ITI/Diploma or Engineering Degree in Mechanical/Electrical or related field.
- Good understanding of basic mechanical principles.
- Proficient in MS Office applications.
- Willingness to learn and adapt to new technologies and processes.
- Strong problem-solving skills and attention to detail.
- Excellent communication and interpersonal skills.
- Locals preferred with a minimum of one year experience or Freshers also welcome
Selection Procedure: CV shortlisting, Online assessment and F2F Interview.
Job Summary:
We are seeking a passionate and detail-oriented Manual and Automation QA Tester to join our growing team. You will play a critical role in ensuring the quality and functionality of our online applications through a combination of manual and automation testing methodologies. In this role, you will be responsible for identifying and reporting bugs, ensuring a seamless user experience, and contributing to the overall success of our platform.
Designation: Sr. Quality Analyst
Roles & Responsibility:
● Develop and execute test plans and test cases to ensure software quality and functionality
● Conduct manual and automated testing, identifying and documenting defects and issues
● Collaborate with developers and other QA team members to identify, reproduce, and resolve defects
● Identify, prioritize, and report defects and issues to the development team
● Develop and maintain automated test scripts to improve testing efficiency
● Perform regression testing to ensure that new features and changes do not negatively impact existing functionality
● Continuously improve the testing process through the use of new testing tools, methodologies, and best practices
● Provide regular reports on testing progress and results to management
● Mentor and train other team members in manual and automation testing techniques
● The ideal candidate will have experience with both manual and automation testing methodologies and tools.
Required Technical skills:
● 5-8 years of experience in the software quality field
● At least 1 year of experience working in the eCommerce domain
● Understanding of existing QA best practices and methodologies to design, implement and automate processes
● Good knowledge in Scrum/Agile methodologies and QA Automation processes in SDLC
● Familiarity with defect & test management tools like ClickUp, Jira, GitLab, and Trello.
● Familiarity with version control tools such as Git, GitHub, and Bitbucket.
● Effective team and subordinate management skills.
● Excellent project time reporting and management capabilities.
● Ability to explain technical matters to non-technical people and propose solutions
● Strong analytical and problem-solving skills with great attention to detail.
● Excellent communication and collaboration skills to work effectively with cross-functional teams.
● Ability to work independently and prioritize tasks to meet project deadlines.
The Benefits
● Service recognition awards.
● Market-leading pay rates
● Regular social and team-building activities.
● Maternity & Paternity Benefits
● Medical Insurance Benefits
About Us
Hexpress Healthcare Softech is a leading IT healthcare services provider based in Vadodara. We belong to the same group as Hexpress Healthcare Limited, a leading online healthcare provider based in London. We supply patients with health solutions and medical advice across multiple countries worldwide, continuously expanding into new markets. We were the first to provide an online consultation and prescription service, allowing our customers to safely order and receive medication from their homes. The Hexpress Healthcare group incorporates trusted brands such as HealthExpress, euroClinix and 121doc.
Hexpress Healthcare has been at the forefront of innovation in the e-health sector since our launch. Patient safety has always been one of our top priorities to guarantee service excellence. We combine excellent industry expertise with technical know-how and work closely with several medical and data protection regulators.
We have always set ourselves apart through the quality of our service. All our staff are extensively trained in best practices, ensuring effectiveness, efficiency and professionalism when dealing with sensitive information. Hexpress is proud to work with a highly professional and fully trained team
Company: https://www.hexpresshealthcare.co.in/
Work Days & Time: Monday to Friday – 11 AM to 8 PM (IST)
Good experience in the Extraction, Transformation, and Loading (ETL) of data from various sources into Data Warehouses and Data Marts using Informatica Power Center (Repository Manager,
Designer, Workflow Manager, Workflow Monitor, Metadata Manager), Power Connect as ETL tool on Oracle, and SQL Server Databases.
Knowledge of Data Warehouse/Data mart, ODS, OLTP, and OLAP implementations teamed with
project scope, Analysis, requirements gathering, data modeling, ETL Design, development,
System testing, Implementation, and production support.
Strong experience in Dimensional Modeling using Star and Snow Flake Schema, Identifying Facts
and Dimensions
Used various transformations like Filter, Expression, Sequence Generator, Update Strategy,
Joiner, Stored Procedure, and Union to develop robust mappings in the Informatica Designer.
Developed mapping parameters and variables to support SQL override.
Created applets to use them in different mappings.
Created sessions, configured workflows to extract data from various sources, transformed data,
and loading into the data warehouse.
Used Type 1 SCD and Type 2 SCD mappings to update slowly Changing Dimension Tables.
Modified existing mappings for enhancements of new business requirements.
Involved in Performance tuning at source, target, mappings, sessions, and system levels.
Prepared migration document to move the mappings from development to testing and then to
production repositories
Extensive experience in developing Stored Procedures, Functions, Views and Triggers, Complex
SQL queries using PL/SQL.
Experience in resolving on-going maintenance issues and bug fixes; monitoring Informatica
/Talend sessions as well as performance tuning of mappings and sessions.
Experience in all phases of Data warehouse development from requirements gathering for the
data warehouse to develop the code, Unit Testing, and Documenting.
Extensive experience in writing UNIX shell scripts and automation of the ETL processes using
UNIX shell scripting.
Experience in using Automation Scheduling tools like Control-M.
Hands-on experience across all stages of Software Development Life Cycle (SDLC) including
business requirement analysis, data mapping, build, unit testing, systems integration, and user
acceptance testing.
Build, operate, monitor, and troubleshoot Hadoop infrastructure.
Develop tools and libraries, and maintain processes for other engineers to access data and write
MapReduce programs.
Selected intern's day-to-day responsibilities include:
- Following up with leads generated to close online sales
- Explain product features to the generated leads to close sales
Stipend structure: This is a performance-based internship. In addition to the minimum-assured stipend, you will also be paid a performance-linked incentive (₹ 200 per sale).
Intuitive cloud (http://www.intuitive.cloud">www.intuitive.cloud) is one of the fastest growing top-tier Cloud Solutions and SDx Engineering solution and service company supporting 80+ Global Enterprise Customer across Americas, Europe and Middle East.
Intuitive is a recognized professional and manage service partner for core superpowers in cloud(public/ Hybrid), security, GRC, DevSecOps, SRE, Application modernization/ containers/ K8 -as-a- service and cloud application delivery
Experience managing, supporting and deploying network infrastructures
Strong ability to diagnose server or network alerts, events or issues
Understanding of common information architecture framework
Perform proactive monitoring and alerting with using ticketing platform and reporting
Ability to perform software upgrades, server and 3rd party application patches, etc.
Perform health-check and proactive maintenance of all the infrastructure devices
Good time management and organizational skills
Ability to handle multiple concurrent tasks and projects with minimal supervision
Knowledge of project management methodologies and techniques
Good verbal as well as written communication skills
Ability to work in a flexible schedule for Rotational 12hrs shift (as per roaster)
Previous customer service or helpdesk experience preferred
Role: Project Manager
Experience: 8-10 Years
Location: Mumbai
Company Profile:
Exponentia.ai is an AI tech organization with a presence across India, Singapore, the Middle East, and the UK. We are an innovative and disruptive organization, working on cutting-edge technology to help our clients transform into the enterprises of the future. We provide artificial intelligence-based products/platforms capable of automated cognitive decision-making to improve productivity, quality, and economics of the underlying business processes. Currently, we are rapidly expanding across machine learning, Data Engineering and Analytics functions. Exponentia.ai has developed long-term relationships with world-class clients such as PayPal, PayU, SBI Group, HDFC Life, Kotak Securities, Wockhardt and Adani Group amongst others.
One of the top partners of Data bricks, Azure, Cloudera (leading analytics player) and Qlik (leader in BI technologies), Exponentia.ai has recently been awarded the ‘Innovation Partner Award’ by Qlik and "Excellence in Business Process Automation Award" (IMEA) by Automation Anywhere.
Get to know more about us at http://www.exponentia.ai and https://in.linkedin.com/company/exponentiaai
Role Overview:
· Project manager shall be responsible to oversee and take responsibility for the successful delivery of a range of projects in Business Intelligence, Data warehousing, and Analytics/AI-ML.
· Project manager is expected to manage the project and lead the teams of BI engineers, data engineers, data scientists and application developers.
Job Responsibilities:
· Efforts estimation, creating a project plan, planning milestones, activities and tracking the progress.
· Identify risks and issues. Come up with a mitigation plan.
· Status reporting to both internal and external stakeholders.
· Communicate with all stakeholders.
· Manage end-to-end project lifecycle - requirements gathering, design, development, testing and go-live.
· Manage end-to-end BI or data warehouse projects.
· Must have experience in running Agile-based project development.
Technical skills
· Experience in Business Intelligence Data warehousing or Analytics projects.
· Understand data lake and data warehouse solutions including ETL pipelines.
· Good to have - Knowledge of Azure blob storage, azure data factory and Synapse analytics.
· Good to have - Knowledge of Qlik Sense or Power BI
· Good to have - Certified in PMP/Prince 2 / Agile Project management.
· Excellent written and verbal communication skills.
Education:
MBA, B.E. or B. Tech. or MCA degree
Company Profile -
Pivotroots Digital summarize all data points across media, design and technology to provide our partners with simplified yet effective consumer-experience-led digital strategies.
Job Description for Copy Writer -
- Understand the client’s business, strategy and product offerings.
- An Integrated part in Ideating & deriving 360˚ strategies along with the research team
- Edit and produce online marketing campaign strategy and content while working closely with web designers on page layout, content organization and graphics.
- Edit content for grammar, accuracy, clarity, readability, consistency, and coherence.
- Manage a project from start to completion.
- Independently research subject matter.
- Self-educate through engineering documentation and product use.
- Develop compelling original content (whitepapers, case studies, newsletters, web content, data sheets, presentations, Blogs, etc.)
- Produce customized templates/Collate technical & functional informatio
Must to have:
- Qualification in BA/MA/ BMM OR any postgraduate in Copywriting/Copy crafting.
- Must have a strong portfolio of live work which must include creative copy written for websites and other digital collaterals.
- Clear, concise and compelling copywriting and editing proofreading skills.
- 3+ Yrs of experience in Digital Marketing
Java Developer (6+ Years. experience) Java, J2EE, Web Services, XML, interface analysis and design JSF Object Oriented Design/ Analysis Knowledge of XML and relational databases (Microsoft SQL Server) TomCat, websphere HTML5, Angular JS, Javascript SOAP, RESTful WebServices Springboot, PCF, Spring cloud services
Skills Required:
Java Developer (6+ Years. experience) Java, J2EE, Web Services, XML, interface analysis and design JSF Object Oriented Design/ Analysis Knowledge of XML and relational databases (Microsoft SQL Server) TomCat, websphere HTML5, Angular JS, Javascript SOAP, RESTful WebServices Springboot, PCF, Spring cloud services
Omnicuris Healthcare, India’s Largest and first of its kind Continuous Medical Education Platform(CME) is an Impact driven organisation which provides an online CME Platform for doctors to continuously stay updated on top of latest medical updates as well as earn mandatory cme credits from regulatory bodies. We are reshaping the way medical education is delivered in India. Having pioneered this concept in India with various state governments, medical associations, councils and medical institutes, Omnicuris provides a comprehensive online platform for a doctor that is credible, accessible and convenient to keep the busy doctors abreast of the latest advancements in medicine. In its short span since inception, Omnicuris enjoys a high reputation for its impactful work from medical institutes, medical associations, regulatory bodies and governments as being a coursera for doctors.
Find us on http://www.omnicuris.com/">www.omnicuris.com
ROLES AND RESPONSIBILITIES:
- Creating buy-in for the product vision both internally and with key external partners
- Developing product positioning strategies
- Translating product strategy into detailed requirements and prototypes
- Gain a deep understanding of customer experience, identify and fill product gaps and generate new ideas that grow market share, improve customer experience and drive growth
- Scope and prioritize activities based on business and customer impact
- Work closely with engineering teams to deliver with quick time-to-market and optimal resources
- Evaluate promotional plans to ensure that they are consistent with product line strategy and that the message is effectively conveyed
- Act as a product evangelist to build awareness and understanding
- Represent the company by visiting customers to solicit feedback on company products and services
- Design and execute multiple A/B and multivariate tests to optimise conversion across different steps of the acquisition funnel from landing pages to conversion
- Analyse and track funnel performance
- use different analytics products to analyse and interpreting trends and provide actionable insights
- Produce meaningful Funnel KPI dashboards and deliver monthly, cross channel performance reports with actionable insights for product, marketing and business teams
- Determining the Digital journey of learners.
Requirements:
● Bachelors in Computer Science, Mathematics or related work experience
- Experience in shipping growth products or working in growth teams preferable
- Excellent problem solving skills with strong ability to break down problems and Strong analytical skills, comfort with handling data sets and deriving insights or building attribution models using the data
- Experience with analytics tools such as Google Analytics, Clevertap/ Mixpanel etc and experience of using MArketing Automation tools like, Webengage, Moengage etc
- Data oriented approach, a key eye for numbers, market insights and an appetite for business context and metrics
- Flawless communication skills, the ability to articulate and evangelize product vision, strategy priority and - Go to market plans- in a compelling manner
- Owner mentality; willingness to take initiatives, the accountability to dive closure
- Tenacity and grit; the ability to hustle and get things done even over a stretch
- The ability to collaborate with cross functional teams yet the assertiveness and influence to rally people around - right- products
- Former entrepreneurs if you have ever started up! we want to talk to you!
- prioritise based on ROI












