25 ETL Jobs in Delhi, NCR and Gurgaon | ETL Job openings in Delhi, NCR and Gurgaon

Role Summary

We are hiring a Data Engineer / ML Data Pipeline Engineer to build and operate the data backbone of the Enterprise AI platform:

What You'll Own

• Ingestion & ETL/ELT pipelines for heterogeneous project folders (PDF drawings, SVG files, IFC models, BBS.json bar-bending-schedule data, Excel exports, and AI agent output JSON).
• AWS-based data architecture: S3 raw/staging/curated/outputs structuring, partitioning, versioning, and lifecycle management; querying via Athena/Glue and warehousing via Redshift or Snowflake as needed.
• Data validation frameworks: GUID cross-referencing between SVG and BBS data, schema enforcement, duplicate/orphan detection, reference integrity checks, and structured validation reporting.
• Agent run logging & observability: designing the database schema and pipelines that track every AI agent run (inputs, outputs, status, errors, cost, retries, reviewer feedback).
• AI Factory monitoring dashboards: operational dashboards (failure rates, retries, latency, data quality) and business dashboards (throughput, cost per run, rework rate) for Power BI/QuickSight or equivalent.
• ML data pipeline support: dataset preparation, labeling/annotation workflows, human-in-the-loop review tooling, and dataset versioning for models that classify or QC drawing issues.
• APIs: designing and building FastAPI/Flask endpoints to trigger validation runs and expose agent processing status to internal tools.
• Data quality & testing discipline: idempotent pipelines, quarantine/reject handling, regression and reconciliation testing, and root-cause debugging when pipelines or query performance degrade in production.

Key Skills — Non-Negotiable (Must-Have, Strong Level)

• Python — production-grade scripting: file/folder handling, JSON/schema processing, clean error handling, not just notebook-level scripting.
• SQL — strong hands-on ability, including GROUP BY/HAVING for duplicate detection, window functions, and daily aggregate/rate calculations (e.g., success-rate queries).
• AWS S3 data handling — practical experience structuring buckets for raw/staging/curated data, versioning, and avoiding overwrite issues at scale.
• Data validation — demonstrable experience building validation logic (set comparisons, duplicate/missing detection, structured pass/fail reporting), not just "I write assertions."
• ETL/ELT pipeline design — end-to-end ownership of at least one pipeline: source → transform → storage → validation → monitoring → business outcome, with clear articulation of what they personally built.
• Query/warehouse engine judgment — working knowledge of when to use Athena vs. Redshift vs. Snowflake (or equivalent), partitioning, clustering, sort/distribution keys, and storage format trade-offs (Parquet vs. JSON vs. CSV).

Key Skills — Good to Have

• Dashboarding — Power BI / QuickSight (or equivalent) fact/dimension table design, KPI cards, drill-downs; medium-to-strong level is a plus but trainable.
• FastAPI / Flask — building real endpoints with request/response schemas and basic error handling; especially valuable for validation-trigger and agent-status APIs.
• ML data pipeline experience — dataset labeling, annotation platform design, train/test/validation splitting, dataset versioning; strong on the pipeline/data side rather than model training itself.
• Human-in-the-loop / review tooling — experience building or contributing to browser-based labeling/review platforms (session persistence, label schema, export formats).
• Large-scale metadata querying — experience making file discovery fast across large volumes (1,000+ projects, thousands of files each) via metadata index tables, event-based ingestion, or catalog tools like AWS Glue.

About the Role

We are looking for a skilled SQL Server DBA with 4–5 years of experience in SQL Server database administration, performance tuning, and enterprise data integration. The ideal candidate should have hands-on experience working with Product Lifecycle Management (PLM) systems, ERP integrations, and data bridge solutions to enable seamless data exchange between enterprise applications.

Key Responsibilities

· Administer, monitor, and maintain Microsoft SQL Server databases to ensure high availability, security, and performance.

· Design, implement, and support PLM–ERP data bridge solutions for seamless integration between Product Lifecycle Management and ERP systems.

· Develop and optimize SQL queries, stored procedures, views, triggers, and database objects.

· Monitor database performance and perform query optimization, indexing, and troubleshooting.

· Design and implement database backup, recovery, disaster recovery, and high availability strategies.

· Build and maintain ETL processes and data synchronization workflows between PLM, ERP, and other enterprise applications. 

· Collaborate with application development teams to support database design and application deployments.

· Perform database migrations, upgrades, patching, and environment maintenance.

· Ensure database security, user management, and compliance with organizational standards.

· Create and maintain technical documentation, database architecture, and operational procedures. 

Required Skills & Experience

· 4–5 years of hands-on experience as a SQL Server DBA.

· Strong expertise in Microsoft SQL Server (2016/2019/2022 or later).

· Excellent knowledge of SQL, T-SQL, Stored Procedures, Functions, Triggers, Views, and Performance Tuning.

· Experience in database backup, restore, replication, indexing, and high availability (Always On, Log Shipping, Replication).

· Hands-on experience working with Product Lifecycle Management (PLM) systems.

· Experience implementing or supporting PLM–ERP data bridge/integration solutions.

· Knowledge of ERP systems such as SAP, Oracle E-Business Suite, Microsoft Dynamics, Infor, or similar platforms.

· Experience with ETL tools and enterprise data integration.

· Strong troubleshooting and root cause analysis skills. 

Preferred Skills

· Experience with Teamcenter, Windchill, Enovia, Arena PLM, or similar PLM platforms.

· Knowledge of SSIS, SSRS, and SSAS.

· Experience with PowerShell or Python scripting for database automation.

· Exposure to Azure SQL Database or cloud-based SQL environments. 

· Understanding of manufacturing, engineering, or product development processes.

· Familiarity with CI/CD and DevOps practices. 

Educational Qualification

· Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.

Key Competencies

· Strong analytical and problem-solving skills.

· Excellent communication and stakeholder management abilities.

· Ability to work independently in a remote environment.

· Strong attention to detail and commitment to database reliability and performance.

· Ability to manage multiple priorities in a fast-paced environment.

Job Title : Report (Power BI) Engineer / Developer

Experience : 5+ Years

Work Mode : Remote (4 days/month office visit)

Locations : Noida, Hyderabad, Chennai, Pune, Bengaluru

Job Summary :

We are looking for an experienced Report (Power BI) Engineer / Developer to design and develop business-critical reporting solutions. The ideal candidate should have strong expertise in Power BI dashboards and paginated reports, along with hands-on experience in SQL Server, Snowflake, and Databricks.

Mandatory Skills :

Power BI, Power BI Dashboards, Paginated Reports, SQL Server, T-SQL, Snowflake, Databricks, Data Warehousing, ETL, SQL Query Optimization.

Key Skills Required :

• 5+ years of experience in Power BI development.
• Strong hands-on experience with Power BI Dashboards and Paginated Reports.
• Excellent knowledge of SQL Server and T-SQL development.
• Experience with Snowflake and Databricks.
• Understanding of data warehousing concepts, ETL processes, and SQL performance optimization.
• Strong communication and collaboration skills.

Preferred Skills :

• Experience with cloud data modernization projects.
• Knowledge of data security and compliance practices.

Note : Comprehensive background verification, including education, employment, criminal, credit, and drug screening, is mandatory.

Review Criteria

• Strong Data / ETL Test Engineer
• 5+ years of overall experience in Testing/QA
• 3+ years of hands-on end-to-end data testing/ETL testing experience, covering data extraction, transformation, loading validation, reconciliation, working across BI / Analytics / Data Warehouse / e-Governance platforms
• Must have strong understanding and hands-on exposure to Data Warehouse concepts and processes, including fact & dimension tables, data models, data flows, aggregations, and historical data handling.
• Must have experience in Data Migration Testing, including validation of completeness, correctness, reconciliation, and post-migration verification from legacy platforms to upgraded/cloud-based data platforms.
• Must have independently handled test strategy, test planning, test case design, execution, defect management, and regression cycles for ETL and BI testing
• Hands-on experience with ETL tools and SQL-based data validation is mandatory (Working knowledge or hands-on exposure to Redshift and/or Qlik will be considered sufficient)
• Must hold a Bachelor’s degree B.E./B.Tech else should have master's in M.Tech/MCA/M.Sc/MS
• Must demonstrate strong verbal and written communication skills, with the ability to work closely with business stakeholders, data teams, and QA leadership
• Mandatory Location: Candidate must be based within Delhi NCR (100 km radius)

Preferred

• Relevant certifications such as ISTQB or Data Analytics / BI certifications (Power BI, Snowflake, AWS, etc.)

Job Specific Criteria

• CV Attachment is mandatory
• Do you have experience working on Government projects/companies, mention brief about project?
• Do you have experience working on enterprise projects/companies, mention brief about project?
• Please mention the names of 2 key projects you have worked on related to Data Warehouse / ETL / BI testing?
• Do you hold any ISTQB or Data / BI certifications (Power BI, Snowflake, AWS, etc.)?
• Do you have exposure to BI tools such as Qlik?
• Are you willing to relocate to Delhi and why (if not from Delhi)?
• Are you available for a face-to-face round?

Role & Responsibilities

• 5 years’ experience in Data Testing across BI Analytics platforms with at least 2 largescale enterprise Data Warehouse Analytics eGovernance programs
• Proficiency in ETL Data Warehouse and BI report dashboard validation including test planning data reconciliation acceptance criteria definition defect triage and regression cycle management for BI landscapes
• Proficient in analyzing business requirements and data mapping specifications BRDs Data Models Source to Target Mappings User Stories Reports Dashboards to define comprehensive test scenarios and test cases
• Ability to review high level and low-level data models ETL workflows API specifications and business logic implementations to design test strategies ensuring accuracy consistency and performance of data pipelines
• Ability to test and validate the migrated data from old platform to an upgraded platform and ensure the completeness and correctness of migration
• Experience of conducting test of migrated data and defining test scenarios and test cases for the same
• Experience with BI tools like Qlik ETL platforms Data Lake platforms Redshift to support end to end validation
• Exposure to Data Quality Metadata Management and Data Governance frameworks ensuring KPIs metrics and dashboards align with business expectations

Ideal Candidate

• 5 years’ experience in Data Testing across BI Analytics platforms with at least 2 largescale enterprise Data Warehouse Analytics eGovernance programs
• Proficiency in ETL Data Warehouse and BI report dashboard validation including test planning data reconciliation acceptance criteria definition defect triage and regression cycle management for BI landscapes
• Proficient in analyzing business requirements and data mapping specifications BRDs Data Models Source to Target Mappings User Stories Reports Dashboards to define comprehensive test scenarios and test cases
• Ability to review high level and low-level data models ETL workflows API specifications and business logic implementations to design test strategies ensuring accuracy consistency and performance of data pipelines
• Ability to test and validate the migrated data from old platform to an upgraded platform and ensure the completeness and correctness of migration
• Experience of conducting test of migrated data and defining test scenarios and test cases for the same
• Experience with BI tools like Qlik ETL platforms Data Lake platforms Redshift to support end to end validation
• Exposure to Data Quality Metadata Management and Data Governance frameworks ensuring KPIs metrics and dashboards align with business expectations

Required Skills: Excellent Communication Skills, Project Management, SQL queries, Expertise with Tools such as Jira, Confluence etc.

Criteria:

• Candidate must have Project management experience.
• Candidate must have strong experience in accounting principles, financial workflows, and R2R (Record to Report) processes.
• Candidate should have an academic background in Commerce or MBA Finance.
• Candidates must be from a Fintech/ Financial service only.
• Good experience with SQL and must have MIS experience.
• Must have experience in Treasury Module.
• 3+ years of implementation experience is required.
• Candidate should have Hands-on experience with tools such as Jira, Confluence, Excel, and project management platforms.
• Need candidate from Bangalore and Delhi/NCR ONLY.
• Need Immediate joiner or candidate with up to 30 Days’ Notice period.

Description

Position Overview

We are looking for an experienced Implementation Lead with deep expertise in financial workflows, R2R processes, and treasury operations to drive client onboarding and end-to-end implementations. The ideal candidate will bring a strong Commerce / MBA Finance background, proven project management experience, and technical skills in SQL and ETL to ensure seamless deployments for fintech and financial services clients.

Key Responsibilities

• Lead end-to-end implementation projects for enterprise fintech clients
• Translate client requirements into detailed implementation plans and configure solutions accordingly.
• Write and optimize complex SQL queries for data analysis, validation, and integration
• Oversee ETL processes – extract, transform, and load financial data across systems
• Collaborate with cross-functional teams including Product, Engineering, and Support
• Ensure timely, high-quality delivery across multiple stakeholders and client touchpoints
• Document processes, client requirements, and integration flows in detail.
• Configure and deploy company solutions for R2R, treasury, and reporting workflows.

Required Qualifications

• Bachelor’s degree Commerce background / MBA Finance (mandatory).
• 3+ years of hands-on implementation/project management experience
• Proven experience delivering projects in Fintech, SaaS, or ERP environments
• Strong expertise in accounting principles, R2R (Record-to-Report), treasury, and financial workflows.
• Hands-on SQL experience, including the ability to write and debug complex queries (joins, CTEs, subqueries)
• Experience working with ETL pipelines or data migration processes
• Proficiency in tools like Jira, Confluence, Excel, and project tracking systems
• Strong communication and stakeholder management skills
• Ability to manage multiple projects simultaneously and drive client success

Qualifications

• Prior experience implementing financial automation tools (e.g., SAP, Oracle, Anaplan, Blackline)
• Familiarity with API integrations and basic data mapping
• Experience in agile/scrum-based implementation environments
• Exposure to reconciliation, book closure, AR/AP, and reporting systems
• PMP, CSM, or similar certifications

Skills & Competencies

Functional Skills

• Financial process knowledge (e.g., reconciliation, accounting, reporting)
• Business analysis and solutioning
• Client onboarding and training
• UAT coordination
• Documentation and SOP creation

Project Skills

• Project planning and risk management
• Task prioritization and resource coordination
• KPI tracking and stakeholder reporting

Soft Skills

• Cross-functional collaboration
• Communication with technical and non-technical teams
• Attention to detail and customer empathy
• Conflict resolution and crisis management

What We Offer

• An opportunity to shape fintech implementations across fast-growing companies
• Work in a dynamic environment with cross-functional experts
• Competitive compensation and rapid career growth
• A collaborative and meritocratic culture

ROLE & RESPONSIBILITIES:

We are hiring a Senior DevSecOps / Security Engineer with 8+ years of experience securing AWS cloud, on-prem infrastructure, DevOps platforms, MLOps environments, CI/CD pipelines, container orchestration, and data/ML platforms. This role is responsible for creating and maintaining a unified security posture across all systems used by DevOps and MLOps teams — including AWS, Kubernetes, EMR, MWAA, Spark, Docker, GitOps, observability tools, and network infrastructure.

KEY RESPONSIBILITIES:

1.     Cloud Security (AWS)-

• Secure all AWS resources consumed by DevOps/MLOps/Data Science: EC2, EKS, ECS, EMR, MWAA, S3, RDS, Redshift, Lambda, CloudFront, Glue, Athena, Kinesis, Transit Gateway, VPC Peering.
• Implement IAM least privilege, SCPs, KMS, Secrets Manager, SSO & identity governance.
• Configure AWS-native security: WAF, Shield, GuardDuty, Inspector, Macie, CloudTrail, Config, Security Hub.
• Harden VPC architecture, subnets, routing, SG/NACLs, multi-account environments.
• Ensure encryption of data at rest/in transit across all cloud services.

2.     DevOps Security (IaC, CI/CD, Kubernetes, Linux)-

Infrastructure as Code & Automation Security:

• Secure Terraform, CloudFormation, Ansible with policy-as-code (OPA, Checkov, tfsec).
• Enforce misconfiguration scanning and automated remediation.

CI/CD Security:

• Secure Jenkins, GitHub, GitLab pipelines with SAST, DAST, SCA, secrets scanning, image scanning.
• Implement secure build, artifact signing, and deployment workflows.

Containers & Kubernetes:

• Harden Docker images, private registries, runtime policies.
• Enforce EKS security: RBAC, IRSA, PSP/PSS, network policies, runtime monitoring.
• Apply CIS Benchmarks for Kubernetes and Linux.

Monitoring & Reliability:

• Secure observability stack: Grafana, CloudWatch, logging, alerting, anomaly detection.
• Ensure audit logging across cloud/platform layers.

3.     MLOps Security (Airflow, EMR, Spark, Data Platforms, ML Pipelines)-

Pipeline & Workflow Security:

• Secure Airflow/MWAA connections, secrets, DAGs, execution environments.
• Harden EMR, Spark jobs, Glue jobs, IAM roles, S3 buckets, encryption, and access policies.

ML Platform Security:

• Secure Jupyter/JupyterHub environments, containerized ML workspaces, and experiment tracking systems.
• Control model access, artifact protection, model registry security, and ML metadata integrity.

Data Security:

• Secure ETL/ML data flows across S3, Redshift, RDS, Glue, Kinesis.
• Enforce data versioning security, lineage tracking, PII protection, and access governance.

ML Observability:

• Implement drift detection (data drift/model drift), feature monitoring, audit logging.
• Integrate ML monitoring with Grafana/Prometheus/CloudWatch.

4.     Network & Endpoint Security-

• Manage firewall policies, VPN, IDS/IPS, endpoint protection, secure LAN/WAN, Zero Trust principles.
• Conduct vulnerability assessments, penetration test coordination, and network segmentation.
• Secure remote workforce connectivity and internal office networks.

5.     Threat Detection, Incident Response & Compliance-

• Centralize log management (CloudWatch, OpenSearch/ELK, SIEM).
• Build security alerts, automated threat detection, and incident workflows.
• Lead incident containment, forensics, RCA, and remediation.
• Ensure compliance with ISO 27001, SOC 2, GDPR, HIPAA (as applicable).
• Maintain security policies, procedures, RRPs (Runbooks), and audits.

IDEAL CANDIDATE:

• 8+ years in DevSecOps, Cloud Security, Platform Security, or equivalent.
• Proven ability securing AWS cloud ecosystems (IAM, EKS, EMR, MWAA, VPC, WAF, GuardDuty, KMS, Inspector, Macie).
• Strong hands-on experience with Docker, Kubernetes (EKS), CI/CD tools, and Infrastructure-as-Code.
• Experience securing ML platforms, data pipelines, and MLOps systems (Airflow/MWAA, Spark/EMR).
• Strong Linux security (CIS hardening, auditing, intrusion detection).
• Proficiency in Python, Bash, and automation/scripting.
• Excellent knowledge of SIEM, observability, threat detection, monitoring systems.
• Understanding of microservices, API security, serverless security.
• Strong understanding of vulnerability management, penetration testing practices, and remediation plans.

EDUCATION:

• Master’s degree in Cybersecurity, Computer Science, Information Technology, or related field.
• Relevant certifications (AWS Security Specialty, CISSP, CEH, CKA/CKS) are a plus.

PERKS, BENEFITS AND WORK CULTURE:

• Competitive Salary Package
• Generous Leave Policy
• Flexible Working Hours
• Performance-Based Bonuses
• Health Care Benefits

Required Qualifications

• Bachelor’s degree Commerce background / MBA Finance (mandatory).
• 3+ years of hands-on implementation/project management experience
• Proven experience delivering projects in Fintech, SaaS, or ERP environments
• Strong expertise in accounting principles, R2R (Record-to-Report), treasury, and financial workflows.
• Hands-on SQL experience, including the ability to write and debug complex queries (joins, CTEs, subqueries)
• Experience working with ETL pipelines or data migration processes
• Proficiency in tools like Jira, Confluence, Excel, and project tracking systems
• Strong communication and stakeholder management skills
• Ability to manage multiple projects simultaneously and drive client success

Preferred Qualifications

• Prior experience implementing financial automation tools (e.g., SAP, Oracle, Anaplan, Blackline)
• Familiarity with API integrations and basic data mapping
• Experience in agile/scrum-based implementation environments
• Exposure to reconciliation, book closure, AR/AP, and reporting systems
• PMP, CSM, or similar certifications

• Technical expertise in the area of development of Master Data Management, data extraction, transformation, and load (ETL) applications, big data using existing and emerging technology platforms and cloud architecture

• Functions as lead developer• Support System Analysis, Technical/Data design, development, unit testing, and oversee end-to-end data solution.

• Technical SME in Master Data Management application, ETL, big data and cloud technologies                                                                                               

• Collaborate with IT teams to ensure technical designs and implementations account for requirements, standards, and best practices                                                                                           

• Performance tuning of end-to-end MDM, database, ETL, Big data processes or in the source/target database endpoints as needed.                                                               

• Mentor and advise junior members of team to provide guidance.                                                  

• Perform a technical lead and solution lead role for a team of onshore and offshore developers

Job Title: Tableau BI Developer

Years of Experience: 4-8Yrs

12$ per hour fte engagement

8 hrs. working

Required Skills & Experience:

✅ 4–8 years of experience in BI development and data engineering

✅ Expertise in BigQuery and/or Snowflake for large-scale data processing

✅ Strong SQL skills with experience writing complex analytical queries

✅ Experience in creating dashboards in tools like Power BI, Looker, or similar

✅ Hands-on experience with ETL/ELT tools and data pipeline orchestration

✅ Familiarity with cloud platforms (GCP, AWS, or Azure)

✅ Strong understanding of data modeling, data warehousing, and analytics best practices

✅ Excellent communication skills with the ability to explain technical concepts to non-technical stakeholders

Job Title : Sr. Data Engineer

Experience : 5+ Years

Location : Noida (Hybrid – 3 Days in Office)

Shift Timing : 2-11 PM

Availability : Immediate

Job Description :

• We are seeking a Senior Data Engineer to design, develop, and optimize data solutions.
• The role involves building ETL pipelines, integrating data into BI tools, and ensuring data quality while working with SQL, Python (Pandas, NumPy), and cloud platforms (AWS/GCP).
• You will also develop dashboards using Looker Studio and work with AWS services like S3, Lambda, Glue ETL, Athena, RDS, and Redshift.
• Strong debugging, collaboration, and communication skills are essential.

Technical Skills:

• Ability to understand and translate business requirements into design.
• Proficient in AWS infrastructure components such as S3, IAM, VPC, EC2, and Redshift.
• Experience in creating ETL jobs using Python/PySpark.
• Proficiency in creating AWS Lambda functions for event-based jobs.
• Knowledge of automating ETL processes using AWS Step Functions.
• Competence in building data warehouses and loading data into them.

Responsibilities:

• Understand business requirements and translate them into design.
• Assess AWS infrastructure needs for development work.
• Develop ETL jobs using Python/PySpark to meet requirements.
• Implement AWS Lambda for event-based tasks.
• Automate ETL processes using AWS Step Functions.
• Build data warehouses and manage data loading.
• Engage with customers and stakeholders to articulate the benefits of proposed solutions and frameworks.

🚀 Exciting Opportunity: Data Engineer Position in Gurugram 🌐

Hello 

We are actively seeking a talented and experienced Data Engineer to join our dynamic team at Reality Motivational Venture in Gurugram (Gurgaon). If you're passionate about data, thrive in a collaborative environment, and possess the skills we're looking for, we want to hear from you!

Position: Data Engineer  

Location: Gurugram (Gurgaon)  

Experience: 5+ years 

Key Skills:

- Python

- Spark, Pyspark

- Data Governance

- Cloud (AWS/Azure/GCP)

Main Responsibilities:

- Define and set up analytics environments for "Big Data" applications in collaboration with domain experts.

- Implement ETL processes for telemetry-based and stationary test data.

- Support in defining data governance, including data lifecycle management.

- Develop large-scale data processing engines and real-time search and analytics based on time series data.

- Ensure technical, methodological, and quality aspects.

- Support CI/CD processes.

- Foster know-how development and transfer, continuous improvement of leading technologies within Data Engineering.

- Collaborate with solution architects on the development of complex on-premise, hybrid, and cloud solution architectures.

Qualification Requirements:

- BSc, MSc, MEng, or PhD in Computer Science, Informatics/Telematics, Mathematics/Statistics, or a comparable engineering degree.

- Proficiency in Python and the PyData stack (Pandas/Numpy).

- Experience in high-level programming languages (C#/C++/Java).

- Familiarity with scalable processing environments like Dask (or Spark).

- Proficient in Linux and scripting languages (Bash Scripts).

- Experience in containerization and orchestration of containerized services (Kubernetes).

- Education in database technologies (SQL/OLAP and Non-SQL).

- Interest in Big Data storage technologies (Elastic, ClickHouse).

- Familiarity with Cloud technologies (Azure, AWS, GCP).

- Fluent English communication skills (speaking and writing).

- Ability to work constructively with a global team.

- Willingness to travel for business trips during development projects.

Preferable:

- Working knowledge of vehicle architectures, communication, and components.

- Experience in additional programming languages (C#/C++/Java, R, Scala, MATLAB).

- Experience in time-series processing.

How to Apply:

Interested candidates, please share your updated CV/resume with me.

Thank you for considering this exciting opportunity.

Greetings !!!

Looking Urgently !!!

Exp-Min 10 Years

Location-Delhi

Sal-nego

Role

AWS Data Migration Consultant

Provide Data Migration strategy, expert review and guidance on Data Migration from onprem to AWS infrastructure that includes AWS Fargate, PostgreSQL, DynamoDB. This includes review and SME inputs on:

·       Data migration plan, architecture, policies, procedures

·       Migration testing methodologies

·       Data integrity, consistency, resiliency.

·       Performance and Scalability

·       Capacity planning

·       Security, access control, encryption

·       DB replication and clustering techniques

·       Migration risk mitigation approaches

·       Verification and integrity testing, reporting (Record and field level verifications)

·       Schema consistency and mapping

·       Logging, error recovery

·       Dev-test, staging and production artifact promotions and deployment pipelines

·       Change management

·       Backup, DR approaches and best practices.

Qualifications

• Worked on mid to large scale data migration projects, specifically from on-prem to AWS, preferably in BFSI domain
• Deep expertise in AWS Redshift, PostgreSQL, DynamoDB from data management, performance, scalability and consistency standpoint
• Strong knowledge of AWS Cloud architecture and components, solutions, well architected frameworks
• Expertise in SQL and DB performance related aspects
• Solution Architecture work for enterprise grade BFSI applications
• Successful track record of defining and implementing data migration strategies
• Excellent communication and problem solving skills
• 10+ Yrs experience in Technology, at least 4+yrs in AWS and DBA/DB Management/Migration related work
• Bachelors degree or higher in Engineering or related field

• Must Have 3-4 Experience in SSIS, Mysql
• Good Experience in Tableau
• Experience in SQL Server.
• 1+ year of Experience in Tableau
• Knowledge of ETL Tool
• Knowledge of Dataware Housing

• Expertise in designing and implementing enterprise scale database (OLTP) and Data warehouse solutions.
• Hands on experience in implementing Azure SQL Database, Azure SQL Date warehouse (Azure Synapse Analytics) and big data processing using Azure Databricks and Azure HD Insight.
• Expert in writing T-SQL programming for complex stored procedures, functions, views and query optimization.
• Should be aware of Database development for both on-premise and SAAS Applications using SQL Server and PostgreSQL.
• Experience in ETL and ELT implementations using Azure Data Factory V2 and SSIS.
• Experience and expertise in building machine learning models using Logistic and linear regression, Decision tree  and Random forest Algorithms.
• PolyBase queries for exporting and importing data into Azure Data Lake.
• Building data models both tabular and multidimensional using SQL Server data tools.
• Writing data preparation, cleaning and processing steps using Python, SCALA, and R.
• Programming experience using python libraries NumPy, Pandas and Matplotlib.
• Implementing NOSQL databases and writing queries using cypher.
• Designing end user visualizations using Power BI, QlikView and Tableau.
• Experience working with all versions of SQL Server 2005/2008/2008R2/2012/2014/2016/2017/2019
• Experience using the expression languages MDX and DAX.
• Experience in migrating on-premise SQL server database to Microsoft Azure.
• Hands on experience in using Azure blob storage, Azure Data Lake Storage Gen1 and Azure Data Lake Storage Gen2.
• Performance tuning complex SQL queries, hands on experience using SQL Extended events.
• Data modeling using Power BI for Adhoc reporting.
• Raw data load automation using T-SQL and SSIS
• Expert in migrating existing on-premise database to SQL Azure.
• Experience in using U-SQL for Azure Data Lake Analytics.
• Hands on experience in generating SSRS reports using MDX.
• Experience in designing predictive models using Python and SQL Server.
• Developing machine learning models using Azure Databricks and SQL Server

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

• Interpret data, analyze results using statistical techniques and provide ongoing reports
• Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality
• Acquire data from primary or secondary data sources and maintain databases/data systems
• Identify, analyze, and interpret trends or patterns in complex data sets
• Filter and “clean” data by reviewing computer reports, printouts, and performance indicators to locate and correct code problems
• Work with management to prioritize business and information needs
• Locate and define new process improvement opportunities
  
  

  Requirements

  • Proven working experience as a Data Analyst or Business Data Analyst
  • https://resources.workable.com/data-scientist-analysis-interview-questions">Technical expertise regarding data models, database design development, data mining and segmentation techniques
  • Strong knowledge of and experience with reporting packages (Business Objects etc), databases (SQL etc), programming (XML, Javascript, or ETL frameworks)
  • Knowledge of statistics and experience using statistical packages for analyzing datasets (Excel, SPSS, SAS etc)
  • Strong https://resources.workable.com/analytical-skills-interview-questions">analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
  • Adept at queries, report writing and presenting findings
  • BS in Mathematics, Economics, Computer Science, Information Management or Statistics