
Lead II - Data Engineering
at Global Digital Transformation Solutions Provider
SENIOR DATA ENGINEER:
ROLE SUMMARY:
Own the design and delivery of petabyte-scale data platforms and pipelines across AWS and modern Lakehouse stacks. You’ll architect, code, test, optimize, and operate ingestion, transformation, storage, and serving layers. This role requires autonomy, strong engineering judgment, and partnership with project managers, infrastructure teams, testers, and customer architects to land secure, cost-efficient, and high-performing solutions.
RESPONSIBILITIES:
- Architecture and design: Create HLD/LLD/SAD, source–target mappings, data contracts, and optimal designs aligned to requirements.
- Pipeline development: Build and test robust ETL/ELT for batch, micro-batch, and streaming across RDBMS, flat files, APIs, and event sources.
- Performance and cost tuning: Profile and optimize jobs, right-size infrastructure, and model license/compute/storage costs.
- Data modeling and storage: Design schemas and SCD strategies; manage relational, NoSQL, data lakes, Delta Lakes, and Lakehouse tables.
- DevOps and release: Establish coding standards, templates, CI/CD, configuration management, and monitored release processes.
- Quality and reliability: Define DQ rules and lineage; implement SLA tracking, failure detection, RCA, and proactive defect mitigation.
- Security and governance: Enforce IAM best practices, retention, audit/compliance; implement PII detection and masking.
- Orchestration: Schedule and govern pipelines with Airflow and serverless event-driven patterns.
- Stakeholder collaboration: Clarify requirements, present design options, conduct demos, and finalize architectures with customer teams.
- Leadership: Mentor engineers, set FAST goals, drive upskilling and certifications, and support module delivery and sprint planning.
REQUIRED QUALIFICATIONS:
- Experience: 15+ years designing distributed systems at petabyte scale; 10+ years building data lakes and multi-source ingestion.
- Cloud (AWS): IAM, VPC, EC2, EKS/ECS, S3, RDS, DMS, Lambda, CloudWatch, CloudFormation, CloudTrail.
- Programming: Python (preferred), PySpark, SQL for analytics, window functions, and performance tuning.
- ETL tools: AWS Glue, Informatica, Databricks, GCP DataProc; orchestration with Airflow.
- Lakehouse/warehousing: Snowflake, BigQuery, Delta Lake/Lakehouse; schema design, partitioning, clustering, performance optimization.
- DevOps/IaC: Terraform with 15+ years of practice; CI/CD (GitHub Actions, Jenkins) with 10+ years; config governance and release management.
- Serverless and events: Design event-driven distributed systems on AWS.
- NoSQL: 2–3 years with DocumentDB including data modeling and performance considerations.
- AI services: AWS Entity Resolution, AWS Comprehend; run custom LLMs on Amazon SageMaker; use LLMs for PII classification.
NICE-TO-HAVE QUALIFICATIONS:
- Data governance automation: 10+ years defining audit, compliance, retention standards and automating governance workflows.
- Table and file formats: Apache Parquet; Apache Iceberg as analytical table format.
- Advanced LLM workflows: RAG and agentic patterns over proprietary data; re-ranking with index/vector store results.
- Multi-cloud exposure: Azure ADF/ADLS, GCP Dataflow/DataProc; FinOps practices for cross-cloud cost control.
OUTCOMES AND MEASURES:
- Engineering excellence: Adherence to processes, standards, and SLAs; reduced defects and non-compliance; fewer recurring issues.
- Efficiency: Faster run times and lower resource consumption with documented cost models and performance baselines.
- Operational reliability: Faster detection, response, and resolution of failures; quick turnaround on production bugs; strong release success.
- Data quality and security: High DQ pass rates, robust lineage, minimal security incidents, and audit readiness.
- Team and customer impact: On-time milestones, clear communication, effective demos, improved satisfaction, and completed certifications/training.
LOCATION AND SCHEDULE:
● Location: Outside US (OUS).
● Schedule: Minimum 6 hours of overlap with US time zones.

Similar jobs
Job Description
Position: Senior Executive - People Experience
Department: Human Resources
Location: Connect and Heal (CNH)
About Connect and Heal (CNH)
At CNH, we strive to create a healthy and engaging workplace by ensuring that employees experience a seamless journey, from onboarding to daily operations. We value people-centric practices that prioritize collaboration, innovation, and care.
Position Summary
The Senior Executive - People Experience will play a pivotal role in delivering exceptional employee experiences across onboarding, recruitment, engagement, and HRMS management. This role requires a proactive individual who can work collaboratively to ensure processes are efficient, compliant, and aligned with CNH’s core values.
Key Responsibilities
1. Onboarding
- Coordinate with hiring managers and cross-functional teams to deliver induction programs.
- Facilitate documentation, verification, and orientation sessions for new employees.
- Ensure compliance with company policies and regulatory requirements during onboarding.
2. Recruitment
- Manage recruitment processes, including job posting, sourcing, screening, scheduling interviews, and offer rollouts.
- Partner with department heads to understand staffing requirements and create effective hiring strategies.
- Maintain a talent pipeline by leveraging social media platforms, job portals, and referral programs.
- Conduct pre-employment checks and reference verifications to ensure quality hiring.
3. Employee Engagement
- Design and implement programs that enhance employee satisfaction, well-being, and retention.
- Plan and execute initiatives such as town halls, team-building activities, and feedback surveys.
- Act as a point of contact for employee queries and provide resolution to concerns in a timely manner.
- Analyze engagement metrics to recommend and implement improvements.
4. HRMS Management
- Oversee the maintenance and accuracy of employee data in the HRMS system.
- Ensure data security and compliance with data protection regulations.
Skills and Qualifications
- Bachelor’s degree in Human Resources, Business Administration, or a related field.
- 1-4 years of experience in HR functions, including onboarding, recruitment, employee engagement, and HRMS.
- Proficient in HRMS tools, Microsoft Office Suite.
- Strong interpersonal and communication skills.
- Ability to handle sensitive information with confidentiality and professionalism.
- Detail-oriented, with strong organizational and multitasking capabilities.
Why Join CNH?
- Be part of a fast-growing organization that prioritizes employee health and well-being.
- Collaborative and inclusive work culture.
- Opportunities for professional growth and development.
We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.
As a Software Engineer III at JPMorgan Chase within the Asset & Wealth Management, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm’s business objectives.
Job responsibilities
- Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
- Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
- Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
- Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
- Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
- Contributes to software engineering communities of practice and events that explore new and emerging technologies
- Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 3+ years applied experience
- Expert level in the programming on Python. Experience designing and building APIs using popular frameworks such as Flask, Fast API
- Familiar with site reliability concepts, principles, and practices
- Experience maintaining a Cloud-base infrastructure
- Familiar with observability such as white and black box monitoring, service level objective alerting, and telemetry collection using tools such as Grafana, Dynatrace, Prometheus, Datadog, Splunk, and others
- Emerging knowledge of software, applications and technical processes within a given technical discipline (e.g., Cloud, artificial intelligence, Android, etc.)
- Emerging knowledge of continuous integration and continuous delivery tools (e.g., Jenkins, Jules, Spinnaker, BitBucket, GitLab, Terraform, etc.)
- Emerging knowledge of common networking technologies
Preferred qualifications, capabilities, and skills
- General knowledge of financial services industry
- Experience working on public cloud environment using wrappers and practices that are in use at JPMC
- Knowledge on Terraform, containers and container orchestration, especially Kubernetes preferred
- Experience 4 - 8 years
- Key Skills for Software Developer C++, Linux :
- - Looking only for candidates who can join immediately or max 10 day
- - should be able to work independently with no handholding
- - the ability to work with C/C++ code on Windows/Linux platforms
- - Database knowledge of MSSQL, Oracle, MySQL/MariaDB, ideally other ones too: Saphana, Teradata, Postgres.
- - Ability to work on their own fixing defects
- - should be able to understand secure coding practices
- - should have the Ability to work independently and with the team across different time zones
What is the role?
We are looking for highly skilled candidates with experience in frontend programming and are
comfortable in dealing with backend tools.
Key Responsibilities
● Reviewing application requirements and interface designs.
● Identifying web-based user interactions.
● Developing and implementing highly-responsive user interface components using React
concepts.
● Writing application interface codes using JavaScript following ReactJS workflows.
● Troubleshooting interface software and debugging application codes.
● Developing and implementing front-end architecture to support user interface concepts.
● Monitoring and improving front-end performance.
What are we looking for?
An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not
match all of it. We are open to promising candidates who are passionate about their work and
are team players.
● 6 to 9 years of strong design and development experience in building massively
large-scale distributed internet systems and products.
● Previous experience working as a React.js Developer.
● In-depth knowledge of JavaScript, CSS, HTML, and front-end languages.
● Strong experience using a client side MVC framework such as NodeJS, ReactJS, or
Redux.
● Experience with user interface design.
● Knowledge of performance testing frameworks including Mocha and Jest.
● Experience with browser-based debugging and performance testing software.
● Experience in responsive design, cross browser compatibility, and website performance.
● Knowledge of frontend CSS frameworks like Bootstrap, Material UI, and preprocessors
like SASS and LESS.
● Experience with handling Services, RESTful, APIs (NodeJS preferably).
Who will you work with?
You will be working with top-quality engineers who have built one of the best employee
engagement SaaS platforms. You will be reporting to the Engineering Head and working closely
with the Architect and other leads.
What can you look for?
A wholesome opportunity in a fast-paced environment that will enable you to juggle between
concepts, yet maintain the quality of content, interact and share your ideas and have loads of
learning while at work. Work with a team of highly talented young professionals and enjoy the
comprehensive benefits that offers.
We are
A fast-growing SaaS commerce company based in Bangalore with offices in Delhi, Mumbai, SF,
Dubai, Singapore, and Dublin. We have three products in our portfolio: Plum, Empuls and
Compass. works with over 1000 global clients. We help our clients in engaging and
motivating their employees, sales teams, channel partners, and consumers for better business
results.
Way forward
We look forward to connecting with you. As you may take time to review this opportunity, we will
wait for a reasonable time of around 3-5 days before we screen the collected applications and
start lining up job discussions with the hiring manager. We assure you that we will attempt to
maintain a reasonable timeframe for successfully closing this requirement. The candidates will
be kept informed and updated on the feedback and application status
✓ Education: Graduate
✓ Inherent ability to have engaging conversations
✓ Excellent listening skills
✓ Excellent communications skills (English) and interpersonal skills
✓ Self-starter and ability to execute high velocity closures
✓ Ability to work in low supervision but high ownership environment
✓ Genuine interest in helping people succeed
planning, execution and optimization of different types of Google Ads (Search Ads, Display
Ads, retargeting, Discovery Ads, and YouTube Ads).
o Be the programmatic expert on campaign performance and optimization by providing
insights into the best strategies and tactics to achieve business objectives
o Leverage first party and third-party data for targeting and insights
o Work closely with the analytics teams to derive meaningful insights and drive a data-backed
strategy
o Own, drive, and report on crucial marketing efficiency metrics such as CAC, ROAS, and LTV
Essential Skills :
- Develop, enhance and maintain Python related projects, data services, platforms and processes.
- Apply and maintain data quality checks to ensure data integrity and completeness.
- Able to integrate multiple data sources and databases.
- Collaborate with cross-functional teams across, Decision Sciences, Search, Database Management. To design innovative solutions, capture requirements and drive a common future vision.
Technical Skills/Capabilities :
- Hands on experience in Python programming language.
- Understanding and proven application of Computer Science fundamentals in object oriented design, data structures, algorithm design, Regular expressions, data storage procedures, problem solving, and complexity analysis.
- Understanding of natural language processing and basic ML algorithms will be a plus.
- Good troubleshooting and debugging skills.
- Strong individual contributor, self-motivated, and a proven team player.
- Eager to learn and develop new experience and skills.
- Good communication and interpersonal skills.
About Company Profile :
Gauge Data Solutions Pvt Ltd :
- We are a leading company into Data Science, Machine learning and Artificial Intelligence.
- Within Gauge data we have a competitive environment for the Developers and Engineers.
- We at Gauge create potential solutions for the real world problems. One such example of our engineering is Casemine.
- Casemine is a legal research platform powered by Artificial Intelligence. It helps lawyers, judges and law researchers in their day to day life.
- Casemine provides exhaustive case results to its users with the use of cutting edge technologies.
- It is developed with the efforts of great engineers at Gauge Data.
- One such opportunity is now open for you. We at Gauge Data invites application for competitive, self motivated Python Developer.
Purpose of the Role :
- This position will play a central role in developing new features and enhancements for the products and services at Gauge Data.
- To know more about what we do and how we do it, feel free to read these articles:
- https://bit.ly/2YfVAsv
- https://bit.ly/2rQArJc
- You can also visit us at https://www.casemine.com/.
- For more information visit us at: - www.gaugeanalytics.com
- Join us on LinkedIn, Twitter & Facebook
Frameworks - Springboot, Hibernate, Junit
REST / SOAP Web Services Implementation
Micro-services and Data Structures experience
SQL and exposure to Oracle or MySql or SQL Server or any standard RDBMS
Scrum or SAFe or other Agile delivery ways
Excellent communication skills (verbal and written), good interpersonal skills, ability to
understand/expand requirements & technical specs
Server Side skills:
Should have handson experience on JS technologies more than 3+ years
Building interactive dasboards from multiple systems and RESTfully
abstract to the UI through a Node.js backend
In depth knowledge of NodeJS, ExpressJS and Restify
Knowledge of authentication using PassportJS, AuthO or JWT.
Knowledge of media content uploading using any cloud
Should have good understanding of request validation, schema
validation and Error handling
Good understanding of Promises, Async/Await and Callbacks
Should have knowledge of Socket, Pubsub.
Payment gateways integration using Braintree, Stripe or any other
would be a good skills to have.
Should have good understanding of scheduled tasks in NodeJS and
CronJobs
In depth knowledge of ORM like Mongoose, Sequalize or KnexJS.
Hands on experience with JavaScript/TypeScript Development on
server side.









