Data Architect (SG0601)

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

• Strong expertise in Data Modeling, Data Design & Modernization
• Primary skills: PySpark, Oracle SQL/PLSQL
• Secondary skills: Python, ETL & Data Pipelines
• Experience with Kafka and Hadoop
• Exposure to AWS / Azure / GCP
• Good knowledge of Git and JIRA

Roles & Responsibilities:

• Design, develop, and modernize scalable data models and data architecture.
• Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
• Build and maintain robust ETL workflows and data pipelines.
• Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
• Perform data transformation, optimization, and performance tuning.
• Collaborate with technical teams on data design, development, testing, and deployment.

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.

Technical Skills

• Strong hands-on experience in Python and PySpark development.
• Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
• Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
• Experience with Power BI Data Modeling and Semantic Layer development.
• Proficiency in DAX (Data Analysis Expressions).
• Experience designing and managing Semantic Models in Power BI.
• Strong SQL skills and experience working with large datasets.
• Knowledge of data warehousing concepts and best practices.

Preferred Skills

• Experience with cloud platforms such as Azure, AWS, or GCP.
• Exposure to modern data platforms like Databricks.
• Understanding of data governance and data quality frameworks.

🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨

Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!

🔹 Role: Senior Data Engineer

🔹 Experience: 7+ Years

🔹 Location: Bangalore

🔹 CTC: Up to 26 LPA

🔹 Notice Period: Immediate to 10 Days Preferred

💻 Mandatory Skills

✅ PySpark

✅ Oracle SQL / PL/SQL

✅ Data Modeling & Design / Modernization

✅ Python

✅ ETL

✅ Data Pipelines

⚙️ Good to Have / Ecosystem Skills

✅ Kafka

✅ Hadoop

✅ AWS / Azure / GCP

✅ Git

✅ JIRA

📌 Key Responsibilities

• Develop and maintain scalable data pipelines using PySpark

• Work extensively with Oracle SQL/PLSQL for data processing and transformation

• Design and implement data models and data architecture

• Work on data design and modernization initiatives

• Develop and optimize ETL processes and data pipelines

• Handle large volumes of data using PySpark and Python

• Work with technologies such as Kafka, Hadoop, and Cloud platforms

• Collaborate with cross-functional teams to deliver scalable data solutions

• Use Git and JIRA for version control and project tracking

📩 Interested candidates can share their updated CV along with:

Total Experience:

Relevant PySpark Experience:

Relevant Oracle SQL/PLSQL Experience:

Data Modeling Experience:

Current Location:

Notice Period:

Current CTC:

Expected CTC:

#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners

Position: Technical Architect – Data Engineering

Job Summary:

• We are looking for an experienced Technical Architect to lead the design and implementation of modern cloud-based data platforms.
• The ideal candidate should have strong expertise in Azure and/or AWS, Databricks, Snowflake, modern data architecture, and large-scale data engineering.
• The candidate will work closely with business stakeholders, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions.

Key Responsibilities

• Design enterprise-scale data lakehouse and data warehouse architectures.

• Define data ingestion, transformation, and serving architecture.

• Lead architecture discussions and technical governance.

• Design scalable ETL/ELT frameworks using Databricks and Snowflake.

• Define best practices for security, performance, CI/CD, and DevOps.

• Guide engineering teams on implementation.

• Collaborate with business, product, and data governance teams.

Must Have Skills :

• Azure or AWS

• Databricks

• Snowflake

• Data Lakehouse Architecture

• PySpark

• SQL

• Data Modelling

• ETL/ELT Architecture

• Performance Optimization

• CI/CD

• Terraform or Infrastructure as Code (preferred)

Preferred

• Insurance domain

• dbt

• Unity Catalog

• Delta Lake

• Iceberg

• Azure Data Factory / AWS Glue  

About the Role

We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.

Key Responsibilities

• Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
• Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
• Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
• Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
• Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
• Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.

Required Skills

• Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
• Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
• Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
• Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
• Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
• Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
• Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
• Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
• Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
• Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.

Nice to Have

• Hands-on exposure to Microsoft Fabric for data integration and analytics.
• Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
• Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
• Domain expertise in financial services.

Data Architect – Databricks & AWS

• Strong experience in Data Architecture, Data Engineering, Databricks, Apache Spark/PySpark, Python, and Advanced SQL.
• Design and implement scalable ETL/ELT pipelines, data platforms, and Lakehouse architectures using Medallion Architecture.
• Experience with Databricks, Databricks Workflows, Unity Catalog OR Databricks Jobs
• Strong knowledge of Delta Lake, Databricks Workflows, Delta Live Tables (DLT), and dimensional data modeling.
• Hands-on experience with AWS services such as S3, Glue, IAM, Lambda, and CloudWatch.
• Experience with Apache Airflow, Data Warehouse concepts, Git/CI-CD, performance optimization, and data quality.
• Good to have exposure to Kafka/Structured Streaming, Unity Catalog, and modern data governance.

Solution Architect – AZURE Data Engineering

Job Overview

We are looking for an experienced Solution Architect – Data Engineering with strong expertise in designing data solutions and hands-on experience with Azure, Synapse, PySpark, Data Warehousing, and Data Lakes. The ideal candidate should have strong architectural and data engineering knowledge.

Key Responsibilities

• Design and implement scalable data architecture and solutions.
• Develop and manage Data Warehouse and Data Lake architectures.
• Design data platforms using Medallion Architecture.
• Lead Data Engineering and ETL activities.
• Work with Azure Synapse Analytics for data processing and analytics.
• Develop data solutions using PySpark / Apache Spark.
• Define and implement data validation and data quality processes.
• Collaborate with business, data, and technology teams to deliver effective data solutions.

Required Skills

• Strong experience in Solution Architecture / Data Architecture.
• Strong knowledge of Data Warehouse and Data Lake architecture.
• Good understanding of Medallion Architecture.
• Strong experience in Data Engineering and ETL.
• Hands-on experience with Microsoft Azure and Azure Synapse Analytics.
• Strong knowledge of PySpark / Apache Spark.
• Experience with Data Validation and Data Quality.
• Good communication and stakeholder management skills.
• 
  

Experience

8+ Years

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

role: data engineer

Python pyspark, SQL, data engineer

5+yrs

Bangalore/Hyderabad

immediate to 15days.

Job Description:

We are seeking a skilled Senior Data Engineer with expertise in Databricks to join our dynamic data team. The ideal candidate will design, build, and maintain scalable data pipelines and architectures to support our organization's data-driven initiatives and leverage Databricks to process large-scale datasets, optimize data workflows, enable advanced analytics and machine learning, and integrate Power BI for data visualization and reporting.

Key Responsibilities

·        5-8 years of professional work experience in a relevant field

·        Proficient in Microsoft Fabric platform, Azure Databricks, ADF, Delta Lake, SQL Data Warehouse, Unity Catalog.

·        Good Experience on Microsoft Dynamics 365

·        Experience/ prior knowledge on semi structure data and Structured Streaming, Azure synapse, data lake, data warehouse.

·        Proficient in creating Azure Data Factory pipelines for ETL/ELT processing; copy activity, custom Azure development etc.

·        Good knowledge of SQL and Python for data manipulation, transformation, and analysis

·        Understand business requirements to set functional specifications for reporting applications

• Data Pipeline Development: Design, develop, and maintain robust, scalable data pipelines using Databricks, Apache Spark, and other cloud-based technologies.
• Data Integration: Ingest, transform, and integrate data from diverse sources, including APIs, databases, streaming platforms, and third-party systems, into Databricks for analytics and reporting.
• Power BI Integration: Develop and optimize data models and datasets in Databricks for use in Power BI, ensuring efficient data connections and high-quality visualizations.
• Performance Optimization: Optimize data workflows, API calls, and queries on Databricks and Power BI for performance, cost-efficiency, and scalability.
• Data Modeling: Build and maintain data models to support business requirements, ensuring data quality, consistency, and accessibility for analytics and reporting.
• Cloud Integration: Implement data solutions on cloud platforms (e.g., AWS, Azure, GCP) integrated with Databricks, Power BI, and API ecosystems.
• Security & Compliance: Implement data governance, security, and compliance best practices within Databricks, Power BI, and API environments.
• Technical Skills:
• Proficiency in Databricks, including Delta Lake, Spark SQL.
• Strong programming skills in Python, Scala, or Java.
• Experience with Apache Spark for big data processing.
• Knowledge of SQL for querying and transforming data.
• Proficiency in Power BI for creating data models, DAX queries, and interactive dashboards.

Preferred Qualifications

• Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).

Experience with real-time data processing and streaming