Cutshort logo
For Employers
Fintech Company logo
Data Warehouse Manager
Fintech Company
Data Warehouse Manager

Data Warehouse Manager at Fintech Company · Bengaluru (Bangalore) · 6 - 8 years · ₹15L - ₹25L / yr · Posted 11 Mar 2022

Jobdost's logo

Data Warehouse Manager

at Fintech Company

Agency job
6 - 8 yrs
₹15L - ₹25L / yr
Bengaluru (Bangalore)
Skills
ETL
Informatica
Data Warehouse (DWH)

Purpose of Job:
We are looking for someone who can manage the daily activities of the
team responsible for the design, implementation, maintenance and
support of data warehouse systems and related data marts. Oversees
data design and the creation of database architecture.


Job Responsibilities:
 7+ years of industry experience and 2+ years of experience
managing a team
 Exceptional knowledge in designing modern Databases such as
MySQL, Postgres, Redshift, Snowflake, Hive or Presto.  Has good experience working in agile based projects.  Has experience in understanding & converting BRD’s into
technical designs.  Work with management to provide effort, estimation and
timelines.  Work closely with IT, Business teams and other internal
stakeholders to resolve business queries within the defined SLA.  Exceptional knowledge in SQL and in designing tables, databases, partitions and query optimization.  Has good experience in designing ETL solutions in tools such as
Talend/AWS Glue/EMR.  Have at least 3 years of experience working on AWS Cloud
 Hands-on in monitoring ETL jobs and performing health check to
ensure data quality
 Have good exposure with AWS Services such as RDS, Aurora, S3, Lambda, Glue, EMR, Step Functions etc.  Design quality assurance tests for ensuring data integrity and
quality
 Good to have Python and big data knowledge


Qualifications:
At least a bachelor’s degree in Science, Engineering, Applied
Mathematics. Masters in Computer Science or related field in preferred. Other Requirements: Leadership skills, excellent communication skills, ability to own tasks

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

company logo
Roshani Mhatre
Posted by Roshani Mhatre
Mumbai, Navi Mumbai
12 - 14 yrs
₹25L - ₹30L / yr
Data architecture

Example:

We are looking for an experienced Data Architect to design, develop, and manage the organization's enterprise data architecture. The candidate will be responsible for building scalable data platforms, ensuring data quality and governance, and supporting business analytics through modern data solutions.

Experience Required

Mention the minimum years of experience.

Example:

  • Minimum 12 years of experience in Data Architecture, Data Engineering, or related fields.
  • 5+ years of experience in the Banking/Financial Services domain is preferred.

Educational Qualification

Mention the required degree.

Example:

  • BE/BTech in Computer Science, Information Technology, Software Engineering, Electronics & Communication Engineering, or equivalent.
  • OR MCA/MTech/MSc in Computer Science, IT, or related disciplines.
  • MBA is preferred.

Technical Skills

List the skills the candidate must have.

Example:

  • AWS, Azure, or GCP
  • Data Warehousing (DWH)
  • ETL/ELT
  • Database Management
  • Data Modeling
  • Data Analytics
  • Data Lakes
  • Data Governance

Key Responsibilities

Convert the points you received into simple action statements.

Example:

  • Design and maintain enterprise data architecture.
  • Develop data warehouses and data lakes.
  • Define data standards and governance policies.
  • Ensure data quality and security.
  • Design ETL/ELT processes.
  • Integrate data from multiple systems.
  • Plan and execute data migration projects.
  • Review existing data architecture and recommend improvements.
  • Provide technical guidance to project teams.
  • Evaluate new data technologies and tools.

Preferred Skills

These are not mandatory but are an advantage.

Example:

  • Banking domain experience
  • Strong analytical and problem-solving skills
  • Good communication skills
  • Leadership and stakeholder management
  • Experience mentoring technical teams


Read more
company logo
Kanakavalli Kosuri
Posted by Kanakavalli Kosuri
Remote only
10 - 16 yrs
Best in industry
Snow flake schema
Data Transformation Tool (DBT)
fivetran
skill iconRuby on Rails (ROR)
skill iconReact.js
+6 more

At Mitratech, we are a team of technocrats focused on building world-class products that simplify operations in the Legal, Risk, Compliance, and HR functions. We are a close-knit, globally dispersed team that thrives in an ecosystem that supports individual excellence and takes pride in its diverse and inclusive work culture centered around great people practices, learning opportunities, and having fun! Our culture is the ideal blend of entrepreneurial spirit and enterprise investment, enabling the chance to move at a rapid pace with some of the most complex, leading-edge technologies available.


For over 35 years, the experts at Mitratech have been focused on solving the complex needs. Today, we serve 20,000 client companies of all sizes globally, representing 30% of the Fortune 500 and over 500,000 users in over 160 countries.


As we continue to grow, we’re always looking for resourceful, enthusiastic, and fresh perspectives. Join our global team and see what makes Mitratech a truly exceptional place to work!


Job Overview 

Principal Data Engineer

About Engineering at Mitratech Legal Solutions 

Mitratech's engineering organization is a collaborative and dynamic environment where engineers are empowered to drive technical direction and innovation. Our engineers are passionate about delivering high-quality products and solutions that meet the evolving needs of our customers, and we're committed to fostering a culture of continuous learning and growth. 


About the Role 

Mitratech is a fast-paced and dynamic environment, and this role requires someone who is adaptable, resilient, and able to thrive in a rapidly changing landscape. If you’re a seasoned engineer with a passion for technical leadership, innovation, and collaboration — including building the data foundations that power trusted reporting and agentic AI-driven products — we’d love to hear from you. 


What You Will Do

•  Drive technical direction for a significant product domain or platform capability, ensuring alignment with business objectives and customer needs 

•  Design and maintain data pipelines and reporting models that power trusted business metrics and increasingly feed agentic AI systems (e.g., RAG ingestion, embeddings, vector stores, AI agent workflows) 

•  Use AI-assisted and agentic engineering tools (e.g., Claude Code, Copilot, Cursor, AI agents) as part of your own workflow, and help other engineers adopt agentic development practices effectively 

•  Reduce systemic complexity by identifying and leading architectural debt remediation, and developing strategies for ongoing technical debt management 

•  Partner with Product and Engineering leadership to inform multi-quarter roadmap feasibility, and provide technical guidance and oversight to ensure successful implementation 

•  Elevate engineering craft across multiple teams through RFCs, mentorship, and knowledge sharing, and develop training programs to improve engineering skills and knowledge 

•  Represent Mitratech’s technical capabilities externally, including speaking at conferences, contributing to open-source projects, and engaging with industry peers and thought leaders 


What We Are Looking For 

To be successful in this role, you will need: 

•  10+ years of experience in software engineering, with a focus on technical leadership and architecture 

•  Deep understanding of data engineering principles, including data modeling, data warehousing, reporting, and data governance 

•  Strong technical expertise in SQL, PostgreSQL, ETL/ELT pipelines, BI tools, and analytics platforms 

•  Practical experience with AI/LLM-adjacent and agentic AI data work — e.g., RAG ingestion pipelines, embedding generation, vector store management, or building/operating AI agent workflows over data — using AI coding assistants (Claude Code, Copilot, Cursor, or similar) as a regular part of the engineering workflow 

•  Working knowledge of modern cloud platforms such as AWS 

•  Experience with BI, reporting, dashboards, and customer-facing analytics 

•  Experience leading cross-functional initiatives with product, engineering, analytics, and business teams 


Nice to Have 

•  Working knowledge of Ruby on Rails and React 

•  Experience with a semantic or metrics layer (e.g., dbt Semantic Layer, headless BI) 

•  Understanding of CI/CD, Git-based workflows, and infrastructure-as-code 

 

The Stack Context 

•  Modern data stack: Fivetran, Airbyte, dbt, Snowflake, GitHub, Terraform, or similar tools 

•  Application context (nice to have): Ruby on Rails, React, or similar backend/frontend frameworks 

•  Data modeling: SQL, analytics models, documentation, testing, naming standards, and version control 

•  Infrastructure: cloud-based data infrastructure, infrastructure-as-code, CI/CD, monitoring, and cloud storage 

•  Data workflows: ingestion, transformation, orchestration, reporting, deployment, and change management 

•  Reporting focus: trusted metrics, scalable reporting models, dashboards, exports, and data quality 

•  AI surface: data pipelines and quality practices supporting AI/LLM and agentic AI use cases (RAG, embeddings, vector stores, AI agents) alongside traditional BI 


Why This Role 

This role offers a unique opportunity to drive technical direction and innovation at a rapidly growing company, while also mentoring and coaching engineers to improve their craft. As a Principal Data Engineer at Mitratech, you will have the chance to work on complex and challenging problems spanning trusted reporting and agentic AI systems, collaborate with cross-functional teams, and represent the company's technical capabilities externally. If you're looking for a role that offers a mix of technical leadership, data and reporting depth, agentic AI innovation, and collaboration, this could be the perfect fit for you. 

 

We are an equal-opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status.

 

Read more
It is an Product Based Company(Domain- EV Charging)
It is an Product Based Company(Domain- EV Charging)
Agency job
via by Mantasha Naaz
Bengaluru (Bangalore)
3 - 5 yrs
₹13L - ₹15L / yr
skill iconAmazon Web Services (AWS)
skill iconPython
PySpark
SQL
ETL
+2 more

Data Engineer

Location: Bengaluru, India (Hybrid)

Employment Type: Full-time

Experience: 3-5 years



Role Overview  

What We’re Looking For:

  • Bachelor’s degree in Computer Science/Engineering or equivalent experience required.
  • Experience designing and shipping cloud services products.
  • Experience driving and managing technical and architectural dependencies on AWS Cloud.
  • A firm understanding of system architecture, cloud computing, PaaS/SaaS design principles, S3, DynamoDB, RDS mandatory.
  • Experience in building or maintaining ETL processes and tools, i.e., AWS Glue or any open-source tool.
  • Proven system-level design contribution to a current “Live” (in production / under daily high load) multi-region SaaS or PaaS offering.
  • Proven experience with S3, DynamoDB, SQL, and AWS RDS services.
  • Proficiency in programming languages such as Python.
  • Strong analytical and problem-solving skills.

Required Skills & Experience

  • Experience with Python, SQL, and data visualization/exploration tools.
  • Familiarity with the AWS ecosystem, specifically S3, DynamoDB, and RDS.
  • Communication skills, especially for explaining technical concepts to nontechnical business leaders.
  • Ability to work on a dynamic, research-oriented team that has concurrent projects.
  • Experience in AWS cost optimization (Savings Plans, Reserved Instances, Spot Instances) and governance frameworks.
  • Experience developing solutions using infrastructure orchestration tools (SSM, automation account, Ansible, etc.).
  • Excellent leadership, stakeholder management, and communication skills.

 

What We Offer

  • Work with some of the brightest minds in the emerging EV industry.
  • Make a tangible impact in reducing carbon emissions and enabling sustainable energy.
  • Freedom to suggest, implement, and innovate on systems, processes, and technologies.
  • Daily ownership in a high-growth, challenging environment.
  • Flexible work environment with hybrid schedules and virtualization options.
  • Competitive pay and benefits including health coverage, innovative PTO program, and performance bonuses.


Read more
company logo
Preetham SR
Posted by Preetham SR
icon

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

Hyderabad, Chennai
5 - 8 yrs
₹5L - ₹13L / yr
ETL
Data Warehouse (DWH)
snowflake
skill iconPython
SQL
+1 more

Location: Hyderabad / Chennai

Experience: 5+ years

Employment type: Full-time, permanent

Work Hours: General Shift

website: www.amazech.com

 

 

Qualifications: 

  • B.E./B.Tech/M.E./M.Tech in Computer Science, Information Technology, Data Science, or related disciplines.
  • Strong academic background with relevant industry experience in Data Engineering and Data Warehousing.

 


 

Key Responsibilities:

·       Design, develop, and maintain scalable data warehouse solutions using Snowflake.

·       Write, optimize, troubleshoot, and enhance Snowflake SQL queries with a focus on performance and scalability.

·       Develop and support ETL processes using Talend to ensure reliable and efficient data movement.

·       Collaborate with business, analytics, and application teams to enable reporting, dashboards, metrics, and data exploration capabilities.

·       Perform data analysis and resolve issues across data ingestion, transformation, and reporting pipelines.

·       Debug and troubleshoot Python-based data processing scripts and automation workflows.

·       Implement best practices for data quality, testing, deployment, and code reviews.

·       Work across UI, API, and Data Warehouse layers to support end-to-end data integration and business requirements.

·       Monitor, optimize, and maintain data warehouse performance and operational stability.

·       Create and maintain technical documentation, data models, and process workflows.

 

Required Skills and Experience: 

·       Strong hands-on expertise in Snowflake Data Warehouse.

·       Advanced SQL skills with experience handling large-scale datasets.

·       Strong understanding of Data Warehousing concepts, dimensional modelling, and data architecture.

·       Hands-on experience with Analytical SQL functions, query tuning, and performance optimization.

·       Experience developing and maintaining ETL solutions using Talend.

·       Proficiency in Python for scripting, debugging, automation, and data processing.

·       Experience integrating UI, API, and Data Warehouse workflows.

·       Strong problem-solving and analytical skills.

·       Experience with testing, code reviews, and deployment best practices.

·       Excellent communication and stakeholder management skills.

Read more
company logo
Hema V
Posted by Hema V
icon

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

Remote, Bengaluru (Bangalore), Noida, Chennai
3 - 10 yrs
Best in industry
Generative AI
LangGraph
ETL
databricks
Retrieval Augmented Generation (RAG)
+1 more

Role Summary

We are hiring a Data Engineer / ML Data Pipeline Engineer to build and operate the data backbone of the Enterprise AI platform:

 

What You'll Own

  • Ingestion & ETL/ELT pipelines for heterogeneous project folders (PDF drawings, SVG files, IFC models, BBS.json bar-bending-schedule data, Excel exports, and AI agent output JSON).
  • AWS-based data architecture: S3 raw/staging/curated/outputs structuring, partitioning, versioning, and lifecycle management; querying via Athena/Glue and warehousing via Redshift or Snowflake as needed.
  • Data validation frameworks: GUID cross-referencing between SVG and BBS data, schema enforcement, duplicate/orphan detection, reference integrity checks, and structured validation reporting.
  • Agent run logging & observability: designing the database schema and pipelines that track every AI agent run (inputs, outputs, status, errors, cost, retries, reviewer feedback).
  • AI Factory monitoring dashboards: operational dashboards (failure rates, retries, latency, data quality) and business dashboards (throughput, cost per run, rework rate) for Power BI/QuickSight or equivalent.
  • ML data pipeline support: dataset preparation, labeling/annotation workflows, human-in-the-loop review tooling, and dataset versioning for models that classify or QC drawing issues.
  • APIs: designing and building FastAPI/Flask endpoints to trigger validation runs and expose agent processing status to internal tools.
  • Data quality & testing discipline: idempotent pipelines, quarantine/reject handling, regression and reconciliation testing, and root-cause debugging when pipelines or query performance degrade in production.

Key Skills — Non-Negotiable (Must-Have, Strong Level)

  • Python — production-grade scripting: file/folder handling, JSON/schema processing, clean error handling, not just notebook-level scripting.
  • SQL — strong hands-on ability, including GROUP BY/HAVING for duplicate detection, window functions, and daily aggregate/rate calculations (e.g., success-rate queries).
  • AWS S3 data handling — practical experience structuring buckets for raw/staging/curated data, versioning, and avoiding overwrite issues at scale.
  • Data validation — demonstrable experience building validation logic (set comparisons, duplicate/missing detection, structured pass/fail reporting), not just "I write assertions."
  • ETL/ELT pipeline design — end-to-end ownership of at least one pipeline: source → transform → storage → validation → monitoring → business outcome, with clear articulation of what they personally built.
  • Query/warehouse engine judgment — working knowledge of when to use Athena vs. Redshift vs. Snowflake (or equivalent), partitioning, clustering, sort/distribution keys, and storage format trade-offs (Parquet vs. JSON vs. CSV).

Key Skills — Good to Have

  • Dashboarding — Power BI / QuickSight (or equivalent) fact/dimension table design, KPI cards, drill-downs; medium-to-strong level is a plus but trainable.
  • FastAPI / Flask — building real endpoints with request/response schemas and basic error handling; especially valuable for validation-trigger and agent-status APIs.
  • ML data pipeline experience — dataset labeling, annotation platform design, train/test/validation splitting, dataset versioning; strong on the pipeline/data side rather than model training itself.
  • Human-in-the-loop / review tooling — experience building or contributing to browser-based labeling/review platforms (session persistence, label schema, export formats).
  • Large-scale metadata querying — experience making file discovery fast across large volumes (1,000+ projects, thousands of files each) via metadata index tables, event-based ingestion, or catalog tools like AWS Glue.
Read more
company logo
SaiSruthi Nuthanpati
Posted by SaiSruthi Nuthanpati
Tirupati, Chennai
5 - 10 yrs
Best in industry
SQL
skill iconPython
Stored Procedures
skill iconAmazon Web Services (AWS)
Microsoft Windows Azure
+10 more

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.


Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.


Key Responsibilities:

  • Design, develop, test, and maintain optimal data pipeline and ETL architectures.
  • Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
  • Prepare and optimize data for predictive and prescriptive modeling.
  • Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
  • Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
  • Utilize big data tools and frameworks to optimize data acquisition and preparation.
  • Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
  • Develop and curate data models for analytics, dashboards, and reports.
  • Conduct code reviews, maintain production-level code, and implement testing approaches.
  • Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
  • Drive innovation and implement efficient new approaches to data engineering tasks.


Must-Have Skills:

  • Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
  • 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
  • 3–5 years of experience designing and implementing data warehouse solutions.
  • Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
  • Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
  • Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
  • Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
  • Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
  • Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
  • Strong problem-solving, communication, and collaboration skills.


Good-to-Have Skills:

  • Experience in integrating ERP data into data lakes.
  • Experience with traditional ETL tools (e.g., Talend, Pentaho).


Competencies:

  • Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
  • Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
  • Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
  • Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
  • Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.


Why Join Us?

  • Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
  • Work on impactful projects that make a difference across industries.
  • Opportunities for professional growth and continuous learning.
  • Competitive salary and benefits package.


Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!


Read more
company logo
aarushi Mahajan
Posted by aarushi Mahajan
UAE
7 - 10 yrs
₹30L - ₹40L / yr
skill iconData Analytics
Migration
skill iconLeadership
Data governance
Business Intelligence (BI)
+4 more

Key Responsibilities

  • Lead end-to-end data migration initiatives, including assessment, planning, mapping, transformation, validation, and reconciliation.
  • Define and implement data governance frameworks, standards, policies, and processes.
  • Design and manage data solutions using Microsoft Azure Data Services.
  • Lead development of BI dashboards, reports, KPIs, and analytics solutions.
  • Work with business and technical stakeholders to understand reporting and data requirements.
  • Develop and maintain data models, data pipelines, ETL/ELT processes, and reporting architecture.
  • Ensure data quality, consistency, integrity, security, and compliance throughout migration and reporting processes.
  • Identify data risks, dependencies, gaps, and migration challenges and drive their resolution.
  • Establish data validation and reconciliation mechanisms to ensure migration accuracy.
  • Provide technical leadership and guidance to data engineers, BI developers, and other project team members.
  • Collaborate with application, cloud, infrastructure, and business teams during project implementation.
  • Monitor data migration and BI deliverables against project timelines, quality standards, and business objectives.
  • Prepare technical documentation, data dictionaries, mapping documents, governance guidelines, and project reports.

Required Skills & Experience

  • 7+ years of experience in data, migration, BI, or related technology roles.
  • Strong experience working on software/IT projects and managing data-related workstreams.
  • Hands-on experience with Microsoft Azure Data Services.
  • Strong understanding of data migration methodologies, ETL/ELT, data transformation, and reconciliation.
  • Experience in Data Governance, Data Quality, Master Data, Metadata Management, and Data Security.
  • Strong experience with BI reporting and dashboard development.
  • Good understanding of SQL and relational databases.
  • Experience with Power BI and data visualization is highly desirable.
  • Knowledge of Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, or equivalent.
  • Strong understanding of data architecture and data lifecycle management.
  • Excellent stakeholder management, communication, analytical, and problem-solving skills.
Read more
company logo
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
company logo
HR eShipz
Posted by HR eShipz
Remote only
6 - 9 yrs
₹8L - ₹18L / yr
Azure
databricks
skill iconPython

Job Summary

The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities

1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.


2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.


3. Design and develop etl processes, data models, and data integration solutions.


4. Provide technical guidance and mentorship to the team members.


5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.


6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.


7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.


Skill Requirements

1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.


2. Strong experience with sql and oracle pl/sql for data querying and manipulation.


3. Advanced programming skills in python for scripting and data processing tasks.


4. Knowledge of data modeling, data warehousing concepts, and database design principles.


5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.


6. Strong analytical and problem-solving skills with attention to detail.


7. Experience in data visualization tools and techniques is a plus.


Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.

Skill (Primary)

Data Fabric-Azure-Azure Data Factory (ADF)

Read more
company logo
Jancy A
Posted by Jancy A
Bengaluru (Bangalore)
5 - 7 yrs
₹4L - ₹20L / yr
Data Engineer,
skill iconPython
ETL
DevOps

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
  • Develop complex and optimized SQL queries, stored procedures, and data transformations.
  • Build and maintain reliable data integration workflows across multiple data sources.
  • Perform data cleansing, validation, transformation, and quality checks.
  • Analyze data and provide insights to support business and technical requirements.
  • Implement and maintain CI/CD pipelines for data engineering applications.
  • Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
  • Troubleshoot data pipeline failures, performance issues, and production incidents.
  • Optimize data processing workflows for performance, scalability, and reliability.
  • Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
  • Follow best practices for version control, testing, documentation, and deployment.
  • Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

  • 5–7 years of hands-on experience in Data Engineering.
  • Strong programming skills in Python.
  • Strong expertise in Advanced SQL and database concepts.
  • Hands-on experience with ETL/ELT processes and data pipelines.
  • Good understanding of Data Warehousing and Data Modeling concepts.
  • Experience with CI/CD practices and tools.
  • Strong understanding of DevOps principles, automation, and deployment processes.
  • Strong data analytics and problem-solving skills.
  • Experience working with large datasets and performance optimization.
  • Good understanding of Git/version control and software development best practices.

Good to Have

  • Hands-on experience with Google Cloud Platform (GCP).
  • Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
  • Experience with containerization/orchestration technologies such as Docker/Kubernetes.
  • Experience with workflow orchestration tools such as Airflow.
  • Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

  • Strong analytical and problem-solving abilities.
  • Good communication and stakeholder management skills.
  • Ability to work independently as well as in a collaborative team environment.
  • Strong ownership of data pipelines and production systems.
  • Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops


Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos