Cutshort logo
For Employers
Quicken Inc logo
Senior Data Quality Engineer
Senior Data Quality Engineer

Senior Data Quality Engineer at Quicken Inc · Bengaluru (Bangalore) · 5 - 8 years · Profitable · Posted 4 Jan 2023

Quicken Inc's logo

Senior Data Quality Engineer

Shreelakshmi M's profile picture
Posted by Shreelakshmi M
5 - 8 yrs
Best in industry
Bengaluru (Bangalore)
Skills
ETL
Informatica
Data Warehouse (DWH)
skill iconPython
ETL QA
Big Data
  • Graduate+ in Mathematics, Statistics, Computer Science, Economics, Business, Engineering or equivalent work experience.
  • Total experience of 5+ years with at least 2 years in managing data quality for high scale data platforms.
  • Good knowledge of SQL querying.
  • Strong skill in analysing data and uncovering patterns using SQL or Python.
  • Excellent understanding of data warehouse/big data concepts such data extraction, data transformation, data loading (ETL process).
  • Strong background in automation and building automated testing frameworks for data ingestion and transformation jobs.
  • Experience in big data technologies a big plus.
  • Experience in machine learning, especially in data quality applications a big plus.
  • Experience in building data quality automation frameworks a big plus.
  • Strong experience working with an Agile development team with rapid iterations. 
  • Very strong verbal and written communication, and presentation skills.
  • Ability to quickly understand business rules.
  • Ability to work well with others in a geographically distributed team.
  • Keen observation skills to analyse data, highly detail oriented.
  • Excellent judgment, critical-thinking, and decision-making skills; can balance attention to detail with swift execution.
  • Able to identify stakeholders, build relationships, and influence others to get work done.
  • Self-directed and self-motivated individual who takes complete ownership of the product and its outcome.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Quicken Inc

Founded :
1982
Type :
Product
Size :
100-500
Stage :
Profitable

About

Quicken personal finance and money management software allows you to manage spending, create monthly budgets, track investments, retirement and more. Download Quicken today!
Read more

Connect with the team

Profile picture
Shruthi Nischal
Profile picture
Shreelakshmi M

Company social profiles

blogtwitterfacebook

Similar jobs (10)

Incubyte
Actively reviewing applications
at Incubyte
4 recruiters
Sarika Shitole
Posted by Sarika Shitole
Remote only
2 - 6 yrs
Best in industry
Data engineering
skill iconPython
SQL
SQL Azure
Data Warehouse (DWH)

About Us


We believe the future of software development is AI-native — where engineers operate at a higher level of abstraction and quality remains non-negotiable. 

Incubyte is a software craft consultancy where the “how” of building software matters as much as the “what”.  

We partner with companies of all sizes, from helping enterprises build, scale, and modernize to early-stage founders bring their ideas to life. 

Our engineers operate in an AI-native development model, using AI as a collaborator across the SDLC to accelerate development while upholding the discipline of software craftsmanship. Guided by Software Craftsmanship and Extreme Programming practices, we build reliable, maintainable, and scalable systems with speed, without compromising quality. If this way of building software resonates with you, we’d like to talk. 


Our Guiding Principles 

These principles define how we work at Incubyte. They are non-negotiable. 


Relentless Pursuit of Quality with Pragmatism 

  We build high-quality systems without losing sight of delivery. 

Extreme Ownership 

  We take responsibility end-to-end for decisions, execution, and outcomes. 

Proactive Collaboration 

  We collaborate closely, challenge each other, and solve problems together. 

Active Pursuit of Mastery 

  We continuously improve our craft and raise our bar. 

Invite, Give, and Act on Feedback 

We seek, give, and act on feedback to get better every day. 

Ensuring Client Success 

We act as trusted partners and focus on real outcomes, not just output. 


Job Description


This is a remote position.


Experience Level

2+ years of experience in SQL, Python, and Snowflake (or equivalent cloud data warehouse), Azure Cloud services.


Role Overview


If you're a Data Craftsperson who takes pride in clean, well-tested data solutions and believes in the principles of Extreme Programming, we'd love to meet you. At Incubyte, we're a DevOps organization where developers own the entire release cycle — you'll get hands-on experience across data engineering, analytics, cloud infrastructure, and direct client communication. This role sits primarily in data engineering (80%) with a meaningful analytics component (20%), supporting our client's data systems end-to-end.


What You'll Do


  • Design, build, and maintain data pipelines and infrastructure using SQL and Python
  • Work within Snowflake to build and optimize data models supporting business use cases
  • Parse and process structured and semi-structured data (JSON, XML) from varied sources
  • Diagnose issues across raw, intermediate, and summary tables
  • Build SQL queries to support repeatable analytics use cases based on stakeholder requirements
  • Investigate and resolve data quality issues, including time-sensitive or urgent ones
  • Identify opportunities to consolidate models and maintain a single source of truth (SSOT)


Requirements


What We're Looking For


  • 2+ years of experience with SQL and relational databases, with the ability to understand complex data relationships and transformations (required)
  • 2+ years of experience with Python for data engineering tasks (required)
  • Experience with Snowflake or an equivalent cloud data warehouse (required)
  • Experience working with Snowflake Coco or any other AI tools(required) 
  • Experience parsing JSON and XML data (a plus)
  • A strong eye for data quality and attention to detail
  • Knowledge of Git (required)
  • Knowledge of Azure cloud services such as Azure Data Factory, Azure Blob Storage, and Azure SQL Database (required)
  • Knowledge of data infrastructure/modeling tools like DBT, Fivetran (a plus)
  • Experience with BI tools like Power BI(a plus, not core to this role)
  • Knowledge of Docker, Linux, Shell/Bash, and virtualization technologies (a plus)
  • Knowledge of SSIS packages (a plus)
  • Familiarity with CI/CD methodologies



Benefits


Life at Incubyte  


We are a remote-first company with structured flexibility. Teams commit to shared rhythms during core hours, ensuring smooth collaboration while maintaining autonomy. Twice a year, we come together in person for a co-working sprint and once a year for a retreat - with all travel expenses covered. 


Our environment is built for crafters: pairing, refactoring, experimenting with AI, and pushing the boundaries of software excellence. We are all lifelong learners, and our work is our passion. 


Perks


  • Dedicated learning & development budget. 
  • Sponsorship for conference talks. 
  • Comprehensive medical & term insurance.
  • Employee-friendly leave policies. 
  • Home Office fund 
  • Medical Insurance



Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
5 - 7 yrs
₹4L - ₹20L / yr
Data Engineer,
skill iconPython
ETL
DevOps

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
  • Develop complex and optimized SQL queries, stored procedures, and data transformations.
  • Build and maintain reliable data integration workflows across multiple data sources.
  • Perform data cleansing, validation, transformation, and quality checks.
  • Analyze data and provide insights to support business and technical requirements.
  • Implement and maintain CI/CD pipelines for data engineering applications.
  • Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
  • Troubleshoot data pipeline failures, performance issues, and production incidents.
  • Optimize data processing workflows for performance, scalability, and reliability.
  • Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
  • Follow best practices for version control, testing, documentation, and deployment.
  • Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

  • 5–7 years of hands-on experience in Data Engineering.
  • Strong programming skills in Python.
  • Strong expertise in Advanced SQL and database concepts.
  • Hands-on experience with ETL/ELT processes and data pipelines.
  • Good understanding of Data Warehousing and Data Modeling concepts.
  • Experience with CI/CD practices and tools.
  • Strong understanding of DevOps principles, automation, and deployment processes.
  • Strong data analytics and problem-solving skills.
  • Experience working with large datasets and performance optimization.
  • Good understanding of Git/version control and software development best practices.

Good to Have

  • Hands-on experience with Google Cloud Platform (GCP).
  • Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
  • Experience with containerization/orchestration technologies such as Docker/Kubernetes.
  • Experience with workflow orchestration tools such as Airflow.
  • Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

  • Strong analytical and problem-solving abilities.
  • Good communication and stakeholder management skills.
  • Ability to work independently as well as in a collaborative team environment.
  • Strong ownership of data pipelines and production systems.
  • Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops


Read more
Fashion brand
Actively reviewing applications
Fashion brand
Agency job
gujarat, Ahmedabad, amraiwadi, Gujrat, Vadodara, Baroda
3 - 6 yrs
₹5L - ₹6L / yr
skill iconData Analytics
PowerBI
Google Apps
VLOOKUP
advanced excel
+2 more

Job Title: Senior Data Analyst

Location: Sharnam Metrolinks, Amraiwadi, Ahmedabad

Working Days: 6 Days a Week

Department: MDO

Reporting To: COO

Employment Type: Full-Time


Job Summary

We are seeking a highly analytical and detail-oriented Senior Data Analyst to lead data management, reporting, automation, and system development initiatives across the organization.

The role focuses on transforming raw data into meaningful insights, designing and implementing automated systems, strengthening data structures, and supporting cross-functional teams with accurate, actionable intelligence to drive strategic and operational business decisions.


Key Responsibilities

1. Data Management & Reporting

● Collect, clean, validate, and consolidate data from multiple internal and external sources.

● Prepare and deliver daily, weekly, and monthly MIS reports for management and departments.

● Design, develop, and maintain dashboards to track KPIs, performance metrics, and operational trends.

2. Database & Data Accuracy Management

● Manage and regularly update internal databases, spreadsheets, and reporting systems.

● Ensure data accuracy, consistency, integrity, and confidentiality across all platforms.

● Implement best practices for data validation, version control, and audit checks.

3. Data Analysis & Business Insights

● Analyze large and complex datasets to identify trends, patterns, gaps, and anomalies.

● Translate data findings into clear, actionable insights and recommendations to support

strategic and operational decision-making.

4. Reporting Automation, System Recommendation & Implementation


● Identify opportunities to replace manual or semi-manual processes with automated, data-driven systems.

● Design and implement automated reporting frameworks, dashboards, and data pipelines using Excel (Power Query, VBA, Macros), SQL, BI tools, and Python.

● Proactively suggest new automation tools, system enhancements, or integrations to

improve efficiency, accuracy, and scalability.

● Lead the end-to-end implementation of approved automation initiatives, including requirement gathering, system design, testing, deployment, and stabilization.

● Continuously monitor and optimize automated systems in line with business growth and evolving data needs.

5. Cross-Functional Coordination & Support

● Collaborate with Sales, HR, Finance, Operations, and other departments to understand

reporting and data requirements.

● Provide support for ad-hoc analysis, custom reports, and special data requests.

● Act as a data partner to department heads for decision support and performance tracking.

6. Documentation & Compliance

● Maintain complete and updated documentation for MIS processes, reports, data models,

automation logic, and system changes.

● Ensure compliance with company data governance policies and applicable data protection standards.


System Development & Data Structuring Responsibilities

● Study and understand departmental workflows to evaluate how data is generated, processed, and utilized.

● Review existing manual and digital data systems to identify operational gaps, risks, and

mprovement opportunities.

● Recommend structured data models, reporting formats, and storage solutions aligned with

business requirements.

● Coordinate with department heads to define data structures, access levels, and reporting

standards.

● Implement new or upgraded data systems (Excel-based models, cloud platforms, ERP

integrations) with minimal operational disruption.


● Design structured data formats and role-based access controls to ensure secure and

organized data management.

● Train employees on newly implemented systems and provide post-implementation

support.

● Monitor system performance, resolve issues, and continuously improve systems based on

user feedback and organizational growth.


Qualifications & Experience

● Bachelor’s degree in Commerce, Statistics, Computer Applications, or a related field.

● 3–5 years of experience in data analytics, reporting, or system automation roles.

● Strong analytical thinking, logical reasoning, and problem-solving abilities.

● High attention to detail with excellent organizational and documentation skills.


Technical Skills (Must Have)

● Advanced Excel: Power Query, Power Pivot, VBA basics, Macros, Charts

● BI Tools: Power BI or Tableau (DAX, data modeling, dashboard optimization)

● Google Apps Script: Automation in Google Sheets, custom functions, triggers, API integrations, workflow optimization

● Vlook


Preferred Skills

● Strong verbal and written communication skills

● Ability to handle sensitive and confidential information responsibly

● Quick learner with a tech-savvy, improvement-driven, and solution-oriented mindset

Read more
Staffnixcom
Actively reviewing applications
Mayank Choudhary
Posted by Mayank Choudhary
Remote only
4 - 6 yrs
₹5L - ₹10L / yr
skill iconPython
SQL

Strong Data Analyst Profile with Python, SQL, and data-pipeline expertise, ideally with retail / e-commerce datasets

2

Mandatory (Experience 1): Must have 4+ years of hands-on data-analyst experience, working with large datasets across areas such as sales, inventory, pricing, promotions, and customer behaviour.

3

Mandatory (Tech skill 1): Must have strong hands-on Python for data processing, transformation, automation, and analysis

4

Mandatory (Tech skill 2): Must have strong SQL skills, including complex queries, joins, aggregations, and data validation.

5

Mandatory (Tech skill 3): Must have a solid understanding of Data Lake architecture, ingestion, storage, and processing workflows

6

Mandatory (Tech skill 4): Must have hands-on experience with ETL / ELT pipelines, data integration, and transformation

7

Mandatory (Tech skill 5): Must have experience with Azure or GCP data services.

8

Mandatory (Tech skill 6): Must have understanding of or experience with Databricks and distributed data processing.

9

Mandatory (Tech skill 7): Must have knowledge of data modeling, data warehousing, and Lakehouse architecture

10

Mandatory (Tech skill 8): Must have experience with Power BI, Tableau, or Excel for reporting.

11

Mandatory (Communication): Must have strong analytical, documentation, and stakeholder-communication skills.

12

Mandatory (Education): Must hold a Bachelor’s degree in Computer Science, IT, Engineering, or a related field.

13

Mandatory (Note1): This is a 6-month contract role. Candidate must be comfortable with the contract engagement and able to join immediately (urgent — onboarding within ~a week)

Read more
Fx31labs
Actively reviewing applications
Darshana Jadhav
Posted by Darshana Jadhav
Remote only
7 - 12 yrs
₹20L - ₹30L / yr
Data engineering
Data architecture
Data Warehouse (DWH)
Data modeling

Job Title: Senior Data Architect

Experience: 7+ Years

Location: India (Ahmedabad / Hybrid/Remote)

Job Summary

We are looking for an experienced Senior Data Architect to support the modernization and enhancement of Enterprise Analytic Data Warehouse (ADW). The candidate will be responsible for evaluating existing data architecture, designing scalable data models, assessing data integration across clinical, operational and financial domains, and establishing data governance and data quality standards.

Key Responsibilities

  • Assess and review the existing Enterprise Analytic Data Warehouse architecture, database structures and data integration processes.
  • Design and improve enterprise data models covering clinical, operational, financial and revenue-cycle information.
  • Define data architecture standards, database structures, data relationships and integration strategies.
  • Evaluate data flows between source systems and the data warehouse.
  • Design and review source-to-target mappings and data lineage.
  • Identify architectural gaps affecting data completeness, consistency, integrity and reporting accuracy.
  • Establish standardized data definitions, data governance practices and metadata management.
  • Ensure consistent patient, facility, payer and other critical identifiers across different datasets.
  • Support integration of billing, claims, payment, denial and accounts receivable (AR) data.
  • Work with SQL and Python-based data processing solutions to investigate and validate data structures.
  • Recommend improvements to warehouse scalability, performance, reliability and maintainability.
  • Develop a prioritized architecture and modernization roadmap for future implementation.
  • Coordinate with data engineers, analytics engineers and business stakeholders.

Required Technical Skills

  • Strong experience in Data Architecture and Enterprise Data Warehousing.
  • Advanced SQL and relational database concepts.
  • Experience with data modelling (conceptual, logical and physical).
  • Knowledge of ETL/ELT pipelines and data integration.
  • Experience with data profiling, data lineage and metadata management.
  • Understanding of data governance, data quality and data validation frameworks.
  • Experience working with large and complex datasets.
  • Python knowledge for data analysis and validation.
  • Experience with cloud-based data platforms or modern data warehouse technologies.

Preferred Skills

  • Experience with Databricks, Azure, AWS or similar cloud data platforms.
  • Experience with healthcare data warehouses.
  • Knowledge of clinical, financial, billing and claims datasets.
  • Understanding of HIPAA, PHI and healthcare data security principles.
  • Experience with healthcare analytics, reimbursement and revenue-cycle data.


Read more
NeoGenCode Technologies Pvt Ltd
Gurugram, Noida, Ahmedabad
4 - 8 yrs
₹6L - ₹12L / yr
PowerBI
skill iconPython
ETL
Data engineering
Azure Data Factory
+8 more

Job Title : Data / AI / GenAI – Engineering & Analytics

Experience : 4+ Years

Location : Noida / Gurugram / Ahmedabad

Employment Type : Full-time | On-site at client location

Working Days : 5 days per week

Working Hours : Standard business hours


Position Overview : We are seeking professionals to deliver modern data engineering, business intelligence, cloud analytics and AI-powered applications, according to their specialization.


Mandatory Skills :

Python, SQL, ETL/ELT, Data Engineering, Power BI, Azure Data Factory, Databricks, PySpark, Data Modeling, GenAI/LLMs, RAG, Vector Databases, AI Agents (as per role specialization).


Key Roles / Specializations :

  1. Power BI Developers : Dashboards, DAX, Power Query, reporting and data modeling
  2. Azure Data Engineers : Azure Data Factory, Data Lake, Azure SQL and cloud pipelines
  3. Databricks Engineers : Apache Spark, PySpark, Delta Lake and scalable processing
  4. Data Engineers : ETL/ELT, SQL, Python, data warehousing and quality
  5. GenAI / RAG Engineers : LLMs, prompts, embeddings, vector databases and retrieval pipelines
  6. Agentic AI Engineers : AI agents, tool calling, orchestration and multi-agent workflows


Key Responsibilities :

  • Design, develop and maintain data pipelines, analytics solutions or AI applications.
  • Build and optimize data integration, transformation and processing workflows.
  • Develop dashboards and analytical models for business decision-making.
  • Use cloud data platforms and modern engineering frameworks.
  • Develop and evaluate LLM applications, RAG solutions or AI agents as applicable.
  • Ensure data quality, security, performance and reliability.
  • Collaborate with engineering teams and stakeholders on testing, deployment and documentation.


Required Skills & Qualifications :

  • Bachelor’s degree in Computer Science, IT, Data Science, Engineering or related discipline.
  • 4–5 years of relevant experience in data, analytics, AI or software engineering.
  • Hands-on expertise in at least one listed specialization; not all technologies are required.
  • Relevant Python, SQL, DAX or other technical skills depending on the position.
  • Understanding of cloud platforms, APIs, integration and software practices.


Preferred Qualifications :

  • Azure, Databricks or Microsoft Fabric experience.
  • For GenAI roles : Azure OpenAI, OpenAI APIs, LangChain, LlamaIndex or LangGraph.
  • For relevant roles : vector databases, CI/CD, Docker, MLOps or LLMOps.


Note : Candidates are expected to have expertise in their relevant specialization, not in every listed technology or role.

Read more
VY SYSTEMS PRIVATE LIMITED
Santhanalakshmi A
Posted by Santhanalakshmi A
Bengaluru (Bangalore), Hyderabad
5 - 12 yrs
₹8L - ₹16L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Read more
Hiring for Product Based MNC
Actively reviewing applications
Hiring for Product Based MNC
Agency job
via TalentOne HR Consulting LLP by sukanya talukdar
Pune
7 - 12 yrs
₹22L - ₹29L / yr
Data engineering
Snow flake schema
skill iconPython
skill iconAmazon Web Services (AWS)
Azure OpenAI

Sr. Data Engineer 

 

Location: Pune

Responsibilities 

· Lead the end-to-end design and development of scalable, high-performance data pipelines and ETL/ELT frameworks aligned with modern data engineering best practices. 

· Architect complex data integration workflows that bring together structured, semi-structured, and unstructured data from both cloud and on-premise sources. 

· Build robust real-time, batch, and on-demand pipelines with built-in observability—monitoring, alerting, and automated error handling. 

· Partner with analysts, data scientists, and business leaders to define and deliver reliable data models, quality frameworks, and SLAs that power key business insights. 

· Ensure optimal pipeline performance and throughput, with clearly defined SLAs and proactive alerting for data delivery or quality issues. 

· Collaborate with platform, DevOps, and architecture teams to build secure, reusable, and CI/CD-enabled data workflows that align with enterprise architecture standards. 

· Establish and enforce the best practices in source control, code reviews, testing automation, and continuous delivery for all data engineering components. 

· Lead root cause analysis (RCA) and preventive maintenance for critical data failures, ensuring minimal business impact and continuous service improvement. 

· Guide the team in establishing standards for data modeling, transformation logic, and governance, ensuring long-term maintainability and scalability. 

· Design and execute comprehensive testing strategies—unit, integration, and system testing—ensuring high data reliability and pipeline resilience. 

· Monitor and fine-tune data pipeline and query performance, optimizing for reliability, scalability, and cost-efficiency. 

· Create and maintain detailed technical documentation, including data architecture diagrams, process flows, and integration specifications for internal and external stakeholders. 

· Facilitate and lead discussions with business and operational teams to understand data requirements, prioritize initiatives, and drive data strategy forward. 

Qualifications 

· 7 to 10 years of hands-on experience in data engineering roles with a proven record of building scalable and secure data platforms. 

· Over 5 years of experience in scripting languages such as Python for data processing, automation, and ETL development. 

· 4+ years of experience with Snowflake, including performance tuning, security model design, and advanced SQL development. 

· 5+ years of experience with data integration tools such as Azure Data Factory, Fivetran, or Matillion. 

· 5+ years of experience in writing complex, highly optimized SQL queries on large datasets. 

· Proven experience integrating and managing APIs, JSON, XML, and webhooks for data acquisition. 

· Hands-on experience with cloud platforms (Azure/AWS) and orchestration tools like Apache Airflow or equivalent. 

· Experience with CI/CD pipelines, automated testing, and code versioning tools (e.g., Git). 

· Familiarity with dbt or similar transformation tools and best practices for modular transformation development. 

· Exposure to data visualization tools like Power BI for supporting downstream analytics is a plus. 

· Strong interpersonal and communication skills with the ability to lead discussions with technical and business stakeholders. 

 

Education 

Bachelor’s or Master’s degree in Computer Science/Information technology or related field. 

Equivalent academic and work experience can be considered. 

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹18L - ₹28L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
Wissen Technology
Actively reviewing applications
at Wissen Technology
4 recruiters
Shivangi Bhattacharyya
Posted by Shivangi Bhattacharyya
Bengaluru (Bangalore)
5 - 12 yrs
Best in industry
Data engineering
Snowflake
ETL
SQL
Data modeling
+1 more

Key Responsibilities & Requirements-


• Hands-on experience designing, building, and developing reporting data warehouses on Snowflake Strong hands-on experience developing and maintaining data pipelines Proven expertise in data modelling for analytical and reporting requirements

• Advanced SQL proficiency

• Hands-on experience resolving data platform and query performance issues

• Hands-on Python experience for data engineering and automation Solid understanding of SDLC for data platforms, including testing, deployment, and support Experience supporting Bl and analytics consumption layers (e.g. Power Bl or equivalent) Familiarity with data governance, data quality, and control frameworks

• Experience working in an Agile, squad-based delivery model

• Strong communication sills, with the ability to clearly articulate complex technical concepts to both technical and non-technical stakeholders


Role summary:

We are looking for a Data Engineer to develop, maintain. and optimize ETL pipelines in a monorepo/ Snowlake environment. The role involves loading data from source files into Snowflake using Python, building data models. and scheduling and monitoring workflows througn AutOSys.

Key responsibilities-

Develop and maintain end-to-end ETL pipelines from source systems and files to Snowflake.

Build Python scripts to ingest and process Cs, JSON, and Parquet files, including validation, transformation, and error handling.

Design and maintain Snowflake data models, tables, views, and transformation logic.

Create and manage Snowflake Dynanic Tables, materialized views, stored procedures, and functions.

Optimize SQL queries, data loading, and Snowflake compute usage for performance and cost efficiency.

Schedule, monitor, and troubleshoot ETLjobs and dependencies using AutoSys.

Investigate data quality issues, reconcile source and target data, and resolve pipeline failures.

Maintain code within a monorepousing Git, code reviews, and established development standards.

Document pipelines, data mappings, oprational procedures, and troubleshooting steps.

Required skills Strong SQL skills, including complexqueries, transformations, and performance tuning.

Proficiency in Python for file processing, automation, and Snowflake integration.

Hands-on experience with Snowflake architecture, warehouses. stages, file formats, and data loading.

Understanding of Snowflake Dynamic Tables, materialized views, stored procedures, and user-defined functions, including their use cases and limitations.

Experience with data modeling and ETL pipeline development. Working knowledge of Autosys scheduling, job dependencies, monitoring, and failure recovery.

Experience processing structured and semi-structured data, particularly CSV, JSON, and Parquet.

Farmiliarity with Git and working in a mongrepo. Strong troubleshooting, docunmentation, and communication skills.

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos