
Job Summary:
Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.
Core Responsibilities:
· Build and manage high-volume data pipelines using Spark/Databricks.
· Implement ELT frameworks using Azure Data Factory/Synapse Pipelines.
· Optimize large-scale datasets in Delta/Iceberg formats.
· Implement robust data quality, monitoring, and governance layers.
· Collaborate with Data Scientists, Analysts, and Business stakeholders.
Technical Stack:
· Big Data: Apache Spark, Kafka, Hive, Airflow, Hudi/Iceberg
· Cloud: Azure (Synapse, ADF, ADLS Gen2), Databricks, AWS (Glue/S3)
· Languages: Python, Scala, SQL
· Storage Formats: Delta Lake, Iceberg, Parquet, ORC
· CI/CD: Azure DevOps, Terraform (infra as code), Git
Senior Data Engineer (Apache Stack + Databricks/Synapse)
Share cv to
Thirega@ vysystems dot com - WhatsApp - 91Five0033Five2Three

Similar jobs
Job Title: DevOps Engineer
Location: Mumbai
Experience: 2–4 Years
Department: Technology
About InCred
InCred is a new-age financial services group leveraging technology and data science to make lending quick, simple, and hassle-free. Our mission is to empower individuals and businesses by providing easy access to financial services while upholding integrity, innovation, and customer-centricity. We operate across personal loans, education loans, SME financing, and wealth management, driving financial inclusion and socio-economic progress. [incred.com], [canvasbusi...smodel.com]
Role Overview
As a DevOps Engineer, you will play a key role in automating, scaling, and maintaining our cloud infrastructure and CI/CD pipelines. You will collaborate with development, QA, and operations teams to ensure high availability, security, and performance of our systems that power millions of transactions.
Key Responsibilities
- Cloud Infrastructure Management: Deploy, monitor, and optimize infrastructure on AWS (EC2, EKS, S3, VPC, IAM, RDS, Route53) or similar platforms.
- CI/CD Automation: Build and maintain pipelines using tools like Jenkins, GitLab CI, or similar.
- Containerization & Orchestration: Manage Docker and Kubernetes clusters for scalable deployments.
- Infrastructure as Code: Implement and maintain IaC using Terraform or equivalent tools.
- Monitoring & Logging: Set up and manage tools like Prometheus, Grafana, ELK stack for proactive monitoring.
- Security & Compliance: Ensure systems adhere to security best practices and regulatory requirements.
- Performance Optimization: Troubleshoot and optimize system performance, network configurations, and application deployments.
- Collaboration: Work closely with developers and QA teams to streamline release cycles and improve deployment efficiency. [nexthire.breezy.hr], [nexthire.breezy.hr]
Required Skills
- 2–4 years of hands-on experience in DevOps roles.
- Strong knowledge of Linux administration and shell scripting (Bash/Python).
- Experience with AWS services and cloud architecture.
- Proficiency in CI/CD tools (Jenkins, GitLab CI) and version control systems (Git).
- Familiarity with Docker, Kubernetes, and container orchestration.
- Knowledge of Terraform or similar IaC tools.
- Understanding of networking, security, and performance tuning.
- Exposure to monitoring tools (Prometheus, Grafana) and log management.
Preferred Qualifications
- Experience in financial services or fintech environments.
- Knowledge of microservices architecture and enterprise-grade SaaS setups.
- Familiarity with compliance standards in BFSI (Banking & Financial Services Industry).
Why Join InCred?
- Culture: High-performance, ownership-driven, and innovation-focused environment.
- Growth: Opportunities to work on cutting-edge tech and scale systems for millions of users.
- Rewards: Competitive compensation, ESOPs, and performance-based incentives.
- Impact: Be part of a mission-driven organization transforming India’s credit landscape.
Role Summary
Provide hands-on leadership across data and analytics initiatives, helping drive execution, coordination, and delivery in a fast-moving, evolving environment.
Key Responsibilities
• Partner closely with Data & Analytics leadership to translate priorities into executable plans.
• Drive delivery across cross-functional teams (data engineering, analytics, platform).
• Manage dependencies, risks, and timelines in a complex enterprise setting.
• Act as a trusted execution lead during periods of rapid change.
Key Skills
• Strong experience in data and analytics programs in large enterprises.
• Comfortable operating with ambiguity and evolving strategy.
• Excellent stakeholder communication and coordination skills.
• Prior healthcare or regulated-industry experience preferred.
About the company:
Our Client enables enterprises in their digital transformation journey by offering Consulting & Implementation Services related to Data Analytics &Enterprise Performance Management (EPM).
Job Location : Noida
Position – Azure Solution Architect
Notice period- Immediate to 60 days
Experience – 6+
Job Description:
Your Role and Responsibilities
- Able to drive the technology design meetings, propose technology design and architecture
- Experienced in the design and delivery of enterprise level Highly Available solutions
- Work closely with project management teams to successfully monitor progress of implementation
- Collaborate with Pre-sales team on RFP
- Provide detailed specifications for proposed solutions
- Experienced to Migrate applications to cloud
- Experienced to create Data Lake and Data warehouse solutions
- Ability to implement the solution as per technical requirements
- Identity, authentication, security, privacy, and compliance including Active Directory modern Application Architecture (Queue’s, Micro-Services, Containers etc)
Required Technical and Professional Expertise
- Project management and leadership skills are essential.
- 4+ years of experience developing IT and cloud infrastructure (MS Azure, GPC).
- Working knowledge of MS Azure technology stack and related technology (ie. Data Factory, Data Flow, Synapse Analytics, Synapse ML, Gen2 storage, etc.).
- Master's degree in Computer Science or Software Engineering preferred.
- Current understanding of best practices regarding system security measures.
- Experience in software engineering and design architecture.
- Positive outlook in meeting challenges and working to a high level.
- Advanced understanding of business analysis techniques and processes.
- Good to have Azure ML experience
Preferred Technical and Professional Experience
- MS Azure Certification: Fundamentals, Solution Architect, Data Engineer
Team Merito
About The Role
CapitalNow.in technical team is seeking a hands-onQA Engineer with a noted experience on Manual Mobile Application, API Testing and has the knowledge on Database.. The technical team is responsible for developing the supported mobile application and web app for customers and a control panel for the marketing team involved in CapitalNow.in.
Responsibilities
- Involved in Product discussions and discussions on impact analysis.
- Writing Test cases and Test scenarios for the application and passing QA for regular updates.
- Daily sanity checks to ensure that the product is working as expected.
- Assured quality, security and compliance requirements are met for supported technology domains.
- Leads modules and as an escalation point, provides guidance and direction to less experienced staff in resolution of highly complex technical problems..
Essential Qualifications
- Have at least 3 years of hands-on working experience in Quality Analysis.
- Have 1+ years of experience in Database Queries (mySQL or similar).
- Have in depth knowledge on writing Test Cases and Test Scenarios.
- Have experience on writing complex queries using MySQL.
- Having knowledge on JIRA or similar tracking tools.
- Experience working in large projects with ability to multitask.
- Strong analytical, communication and interpersonal skills.
Desired Qualifications
- Having experience working in the Financial Services domain (good if it's in capital markets) is an added advantage.
- Immediate joiner is most preferable.
geography, ABPs (Agents), LAs and customer’s location (as and when required).
You will be evaluated on your ability to build a strong distribution and sustainable network to meet
your business targets (No. of active, successful ABPs (Agents) and LAs, distribution build up and
overall premium targets).
As a team manager, you will accompany the team of ABPs on pre and post sales such as claim
settlement.
HDFC Life believes in technology driven sales and you will learn new technology/Mobility
enhancements, to comply with the Sales Management Process.
As a business development professional you will be uphold organizational values in every action
and ensure business ethics and integrity. You are expected to be compliant to regulatory and
statutory regulations
Inside Sales Associate Responsibilities:
- Persuade prospective clients to engage in a phone conversation and/or meeting to discuss our insurance product.
- Connect with prospects over a call (min of 45 calls to be connected each day)
- Advise clients on the insurance policies that best suit their needs
- Customize insurance programs to suit individual clients
- Deliver approved policies to new clients and explain benefits of the policy
- Issue quotes, maintain client records and prepare reports
- Keep abreast of industry and market trends and best practices
- Scout and identify potential clients with need for insurance coverage
- Contact potential customers through calls, emails and arranged meetings
- Provide elaborate explanation of contract features, benefits, and possible downsides to an insurance coverage (as per market perspective).
- Ensure company policies and procedures are maintained when conducting the sales of insurance services
- Discuss with clients to obtain information in order to provide Quotation.
- Facilitate the payment and handover to post sales team.
Requirements:
- SME’s in corporate sales with minimum of 90% sales target achievement rate each month.
- Minimum of 4-5 hours of calling per day required.
- Corporate Sales experience with Tier 1 organisation contributing to the monthly targets
- Connect with prospects over a call (min of 45 calls to be connected each day)
- Previous working experience in Insurance.
- Excellent communication and presentation skills
- Resilient spirit and a persistent nature
- Impeccable interpersonal skills and friendly attitude
- Well organized with time, excellent time management abilities
- Should be a graduate.
Desired Profile:
- Strong analytical skills -ability to turn business requirements into technical concepts and code
- Minimum 3 years experience in NodeJS(at least 3 projects with minimum 1 project as the sole lead developer)
- Deep knowledge of Javascript and Typescript (at least 2 years)
- Should have experiences with NestJS
- Experience with SCRUM/Agile Development
- At least worked in one microservice/cloud project
- Familiar with designing and implementing a CI/CD process (Azure DevOps plus)
- Testing and Documenting should be the day to day practice
- Experience with Azure & Serverless functions is a plus
- Experience with Monorepositories and Nx is a plus
Ideal candidates should have technical experience in migrations and the ability to help customers get value from Datametica's tools and accelerators.
Job Description
Experience : 7+ years
Location : Pune / Hyderabad
Skills :
- Drive and participate in requirements gathering workshops, estimation discussions, design meetings and status review meetings
- Participate and contribute in Solution Design and Solution Architecture for implementing Big Data Projects on-premise and on cloud
- Technical Hands on experience in design, coding, development and managing Large Hadoop implementation
- Proficient in SQL, Hive, PIG, Spark SQL, Shell Scripting, Kafka, Flume, Scoop with large Big Data and Data Warehousing projects with either Java, Python or Scala based Hadoop programming background
- Proficient with various development methodologies like waterfall, agile/scrum and iterative
- Good Interpersonal skills and excellent communication skills for US and UK based clients
About Us!
A global Leader in the Data Warehouse Migration and Modernization to the Cloud, we empower businesses by migrating their Data/Workload/ETL/Analytics to the Cloud by leveraging Automation.
We have expertise in transforming legacy Teradata, Oracle, Hadoop, Netezza, Vertica, Greenplum along with ETLs like Informatica, Datastage, AbInitio & others, to cloud-based data warehousing with other capabilities in data engineering, advanced analytics solutions, data management, data lake and cloud optimization.
Datametica is a key partner of the major cloud service providers - Google, Microsoft, Amazon, Snowflake.
We have our own products!
Eagle – Data warehouse Assessment & Migration Planning Product
Raven – Automated Workload Conversion Product
Pelican - Automated Data Validation Product, which helps automate and accelerate data migration to the cloud.
Why join us!
Datametica is a place to innovate, bring new ideas to live and learn new things. We believe in building a culture of innovation, growth and belonging. Our people and their dedication over these years are the key factors in achieving our success.
Benefits we Provide!
Working with Highly Technical and Passionate, mission-driven people
Subsidized Meals & Snacks
Flexible Schedule
Approachable leadership
Access to various learning tools and programs
Pet Friendly
Certification Reimbursement Policy
Check out more about us on our website below!
www.datametica.com
Key Responsibilities:
- Reviewing software requirements and preparing test scenarios.
- Executing tests on software usability.
- Analyzing test results on database impacts, errors or bugs, and usability.
- Preparing reports on all aspects related to the software testing carried out and reporting to the design team.
- Interacting with clients to understand product requirements.
- Participating in design reviews and providing input on requirements, product design, and potential problems.
Job Requirements:
- A bachelor's degree in computer science or related field.
- Up-to-date knowledge of software test design and testing methodologies.
- Working knowledge of test techniques and compatibility with various software programs.
- Working knowledge of programming.
- Excellent communication and critical thinking skills.
- Good organizational skills and detail-oriented mindset.










