Data Architect

Dear Candidate,

Greeting from NAM Info Pvt Ltd.

We have a role for Data Engineer position with NAM Info.

This role will be permanent with NAM info and deploy to client

location NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA.

Work Mode: WORK FROM OFFICE

A decent hike can be provided based on current CTC

Interview Mode: Virtual

Role Descriptions:

Exp Range: 7 - 10 years

City Locations: NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA

Key Responsibilities*

Role: Data Engineer

Location: ~NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA

Skills: Digital: Databricks, Azure Data Factory

Experience Required: 8-10

Descriptions:

Good information and sound knowledge in Azure Synapse Analytics Azure Data Factory (ADF)Big Data technologies and data processing frameworks Azure Data Warehouse and associated Azure data platform services Data integration| data modelling| and performance optimization

Desire candidate

• Candidate should have valid PF.

Regards,

NAM Info 

Azure Data Factory and Azure Databricks, processing 5 million+ records/week from 4+ source systems into a governed Lakehouse. 

Solution Architect – AZURE Data Engineering

Job Overview

We are looking for an experienced Solution Architect – Data Engineering with strong expertise in designing data solutions and hands-on experience with Azure, Synapse, PySpark, Data Warehousing, and Data Lakes. The ideal candidate should have strong architectural and data engineering knowledge.

Key Responsibilities

• Design and implement scalable data architecture and solutions.
• Develop and manage Data Warehouse and Data Lake architectures.
• Design data platforms using Medallion Architecture.
• Lead Data Engineering and ETL activities.
• Work with Azure Synapse Analytics for data processing and analytics.
• Develop data solutions using PySpark / Apache Spark.
• Define and implement data validation and data quality processes.
• Collaborate with business, data, and technology teams to deliver effective data solutions.

Required Skills

• Strong experience in Solution Architecture / Data Architecture.
• Strong knowledge of Data Warehouse and Data Lake architecture.
• Good understanding of Medallion Architecture.
• Strong experience in Data Engineering and ETL.
• Hands-on experience with Microsoft Azure and Azure Synapse Analytics.
• Strong knowledge of PySpark / Apache Spark.
• Experience with Data Validation and Data Quality.
• Good communication and stakeholder management skills.
• 
  

Experience

8+ Years

Job Description

• Design and Implement Data Solutions: Lead the design, development, and implementation of scalable and secure Azure-

based data platforms, ensuring integration with various data sources and business systems. Deliver at least 2 major

projects every year with a focus on data engineering best practices.

• Optimize Data Pipelines: Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Databricks, and

Azure Synapse, with an emphasis on automating data workflows. Achieve a 20% reduction in pipeline execution times

within the first 6 months.

• Cloud Infrastructure Management: Manage and maintain the Azure data environment, ensuring high availability, disaster

recovery, and cost optimization. Track and improve system uptime to exceed 99.9% reliability.

• Collaborate with Cross-Functional Teams: Partner with data scientists, data analysts, and business stakeholders to translate

business requirements into efficient data solutions. Facilitate at least 3 collaborative sessions per quarter to address key

business use cases.

• Ensure Data Security & Compliance: Implement data security measures, ensuring compliance with industry regulations

(GDPR, HIPAA, etc.) and company policies. Achieve and maintain full compliance in all data environments within the first

quarter of onboarding.

• Continuous Learning & Knowledge Sharing: Stay up-to-date with emerging Azure technologies, and mentor junior

engineers to promote knowledge sharing. Complete 1 Azure certification annually and conduct at least 2 internal

knowledge-sharing sessions per year.

• Sound knowledge of data governance practices, data quality management, and data security principles.

• Play a pivotal role in shaping our organization's data-driven journey, driving innovation through data analytics and insights.

• Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage

services (such as Azure Data Lake Storage, Azure SQL Database, etc.), data processing services (such as Azure Data Bricks,

Azure Synapse, etc.) and data visualization (PowerBI, Qlik, etc.) & integration services (Data API builder, logic apps, etc.)

• Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for

continuous improvement.

• Collaborate with DevOps teams to automate deployment, configuration, and monitoring processes using Azure DevOps,

PowerShell, or other relevant tools.

• Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting

new technologies or features to enhance the data platform.

• Document technical designs, procedures, and guidelines for data platform engineering and operations

Knowledge, Skills & Experience

Job Experience • Bachelor's degree in Computer Science, Engineering, or a related field. Advanced

degree preferred.

• Proven 6-10 years experience in playing platform engineer or admin role

• Experience with big data technologies such as Apache Spark, Hadoop, or similar

frameworks.

• Solid understanding of cloud computing concepts and experience with cloud

infrastructure management and provisioning.

• Solid understanding of network security concepts and technologies (such as

firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security

concepts and technologies (such as access controls, encryption, observability,

privacy laws/regulations, etc.)

• Experience in a Retail setup is preferred.

Required Skills The position will require someone with the following:

• Strategic Planning

Public

• Communication and Collaboration

• Problem Solving Skills A/B testing & experimentation

• SQL, BI tools, and storytelling with data

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.

Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.

Key Responsibilities:

• Design, develop, test, and maintain optimal data pipeline and ETL architectures.
• Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
• Prepare and optimize data for predictive and prescriptive modeling.
• Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
• Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
• Utilize big data tools and frameworks to optimize data acquisition and preparation.
• Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
• Develop and curate data models for analytics, dashboards, and reports.
• Conduct code reviews, maintain production-level code, and implement testing approaches.
• Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
• Drive innovation and implement efficient new approaches to data engineering tasks.

Must-Have Skills:

• Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
• 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
• 3–5 years of experience designing and implementing data warehouse solutions.
• Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
• Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
• Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
• Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
• Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
• Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
• Strong problem-solving, communication, and collaboration skills.

Good-to-Have Skills:

• Experience in integrating ERP data into data lakes.
• Experience with traditional ETL tools (e.g., Talend, Pentaho).

Competencies:

• Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
• Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
• Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
• Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
• Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.

Why Join Us?

• Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
• Work on impactful projects that make a difference across industries.
• Opportunities for professional growth and continuous learning.
• Competitive salary and benefits package.

Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!

Job description: Data Architect – Databricks / AWS

Job Summary

We are looking for an experienced Data Architect to define and drive the target data architecture for the Horizon MVP and its future evolution. The role will be responsible for designing a scalable, secure, governed cloud data platform covering ingestion, storage, processing, analytics, APIs, and downstream data consumption.

The architect will work closely with Data Engineering, Backend, DevOps, QA, and business stakeholders to establish architecture standards and ensure the platform is ready for advanced analytics, AI/ML, vector storage, and future LLM-based capabilities.

• Job Title: Data Architect
• Experience: 8+ Years
• Relevant Architecture Experience: 3+ Years in Data Architecture
• Location: Chennai / Pune
• Work Mode: Hybrid – 3 Days WFO
• Budget: Up to 24 LPA
• Payroll: Haparz
• Notice Period: Immediate Preferred

Key Responsibilities

• Define the target data architecture for the Horizon MVP and establish an architecture roadmap for future scalability.
• Design end-to-end architecture covering data ingestion, storage, processing, serving, reporting, APIs, and downstream applications.
• Establish canonical data models and schemas for travel signals, corridors, sources, evidence, scores, and generated insights.
• Define data normalization strategies for structured, semi-structured, and unstructured data from multiple external sources.
• Design and govern the Databricks platform architecture, including Unity Catalog, data schemas, access controls, and governance standards.
• Establish data-retention, lineage, data-quality, security, privacy, and compliance controls.
• Define secure integration patterns between Databricks, AWS PRODIGY, SharePoint, external APIs, and downstream applications.
• Design scalable data processing for 30-day signal windows, convergence/divergence scoring, corridor ranking, and spike detection.
• Define architecture patterns that support future vector storage, embeddings, LLM integration, and multi-year analytics.
• Design reliable batch and API-driven ingestion frameworks for structured and unstructured data.
• Review technical designs, identify architectural risks, and provide technical direction to engineering teams.
• Guide backend, data engineering, DevOps, and QA teams in implementing architecture standards.
• Ensure architecture decisions align with enterprise security, RBAC, PII handling, privacy, and operational requirements.
• Communicate architecture decisions, trade-offs, and technical recommendations effectively to technical and business stakeholders.
• 
  

What We’re Looking For

• 8+ years of experience in data engineering, data platforms, or data architecture, with at least 3+ years in a Data Architect capacity.
• Strong hands-on experience designing cloud-based data platforms, lakehouses, or analytical platforms.
• Advanced knowledge of Databricks, Apache Spark/PySpark, Delta Lake, and Unity Catalog.
• Strong understanding of AWS data services, IAM, networking, and secure cloud integration patterns.
• Strong expertise in data modelling, metadata management, data lineage, data quality, retention, and governance.
• Experience architecting batch and API-based ingestion pipelines for structured, semi-structured, and unstructured data.
• Understanding of AI/ML workloads, feature pipelines, vector databases, embeddings, and LLM integration patterns.
• Experience designing APIs and downstream data-serving architectures.
• Strong knowledge of PII protection, RBAC, data privacy, and enterprise security controls.
• Excellent architectural communication and stakeholder-management skills.

Roles & Responsibilities

• Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration

of enterprise-wide data from diverse sources

• Build and optimize data engineering workflows using Databricks and PySpark

• Write efficient, high-performance SQL for data transformation and analysis

• Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing,

data models, and pipelines

• Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the

development lifecycle

• Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production

environments with proper change control processes

• Collaborate with cross-functional teams to translate business requirements into scalable data solutions

• Ensure data quality, reliability, and performance across all pipelines and platforms

Ideal Candidate

1Strong Azure Databricks Engineer / Senior Data Engineer Profile

2Mandatory (Experience 1) – Must have minimum 8+ years of overall experience in Data Engineering, Data Development, or related data technology roles, with strong hands-on experience in enterprise data pipeline development.

3Mandatory (Experience 2) – Must have strong hands-on experience with Azure Databricks, including development and optimization of scalable data engineering workflows using Databricks and PySpark.

4Mandatory (Experience 3) – Must have strong hands-on proficiency in PySpark/Python and SQL, with proven experience developing complex data transformations, processing workflows, and performance-optimized queries.

5Mandatory (Experience 4) – Must have hands-on experience with Azure Data Factory (ADF) for designing, developing, and orchestrating end-to-end data pipelines and integrating data from multiple sources.

6Mandatory (Experience 5) – Must have strong experience working on the Azure Cloud platform and associated data services, with solid understanding of data warehousing, data modeling, pipeline architecture, and enterprise data solutions.

7Mandatory (Experience 6) – Must have hands-on experience implementing CI/CD using Azure DevOps, including deployment and release management across development, QA, and production environments.

8Mandatory (Experience 7) – Must have proven technical leadership experience, including code reviews, enforcing development best practices, mentoring developers, and providing technical guidance to a data engineering team.

9Mandatory (Notice Period) – Immediate joiners or candidates who can join within 15 days.

10Mandatory (Note) - The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location.

Role Descriptions: Azure data engineer

SN Required Information Details

1 Role** Azure Cosmos DB Developer

2 Required Technical Skill Set** Primary - PySpark Azure Cosmos DB

Secondary -Python, Microsoft Fabric

3 No of Requirements** 4

4 Desired Experience Range** 8 to 12

5 Location of Requirement Pune

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

1. Deep hands-on experience with Python,Pyspark,Spark batch,notebook in Azure

2. Experience in Cosmos DB – including data modeling, indexing, partitioning, consistency levels, and performance tuning.

3. Strong understanding of Cosmos DB APIs (Core SQL API, MongoDB API, etc.) and integration patterns.

4. Proficiency in query optimization and troubleshooting Cosmos DB performance issues.

5. Experience in data processing using PySpark and Python.

6. Familiarity with Microsoft Fabric for data engineering and analytics workflows.

7. Proficient using source code management tools such as Git or GitHub

8. Experience with Test Driven Development and / or Behavior Driven Development.

Good-to-Have 1. Exposure to data governance tools like Azure Purview.

2. Familiar with various design patterns

3. Familiar with Azure: SQL Managed Instance, Cosmos DB, Storage Services, Azure Functions

4. Global project experience, and excellent communication skills, verbal and written, and soft skills in agile projects

SN Responsibility of / Expectations from the Role

1 Design and implement scalable and high-performance solutions using Azure Cosmos DB.

2 Develop data ingestion and transformation pipelines using PySpark and Azure Data Factory.

3 Optimize Cosmos DB performance through indexing, partitioning, and query tuning.

4 Collaborate with architects and data engineers to ensure best practices in data modeling and cloud architecture.

5 Implement and maintain CI/CD pipelines for automated deployments and testing.

6 Troubleshoot and resolve technical issues related to Cosmos DB and data pipelines.

Desirable Skills:

Keyword:

Skills: Digital : Python~Digital : Databricks~Digital : PySpark~Microsoft Fabric~MySQL

Experience Required: 8-10.

What you'll need

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related technical field.
• 5+ years of professional data engineering experience.
• Experience designing and building cloud-native data solutions.
• Strong expertise with Google Cloud Platform, including BigQuery. Experience developing transformation frameworks using dbt.
• Strong SQL and Python programming skills.
• Experience with PostgreSQL or other relational databases.
• Experience orchestrating workflows using Apache Airflow or Cloud Composer.
• Experience implementing Infrastructure as Code using Terraform. Experience building CI/CD pipelines using GitHub Actions, GitLab CI, Jenkins, or similar platforms.
• Experience developing scalable batch and streaming data pipelines. Strong problem-solving skills with the ability to balance scalability, reliability, and cloud cost optimization.

Preferred Qualifications

• Experience with Pub/Sub, Datastream, Dataflow, Cloud Storage, Cloud Functions, or Cloud Run.
• Experience building multi-tenant SaaS platforms.
• Experience implementing metadata-driven governance, lineage, and data quality frameworks.
• Experience supporting AI, machine learning, or customer-facing analytics platforms.
• Experience with Kubernetes and Docker.

Job Description:

Experience: 10+ Years

Job Summary

We are looking for an experienced Azure Fabric Data Architect to lead the design and implementation of an enterprise data platform on Microsoft Fabric. The role involves architecting scalable data solutions, defining data governance, and enabling AI-driven analytics for a global financial services client.

Key Responsibilities

• Design end-to-end data architecture using Microsoft Fabric.
• Build enterprise Lakehouse, Data Warehouse, and OneLake solutions.
• Define data ingestion, ETL/ELT, governance, security, and performance strategies.
• Lead architecture for AI-powered analytics, AI Agents, and enterprise chatbots using Azure AI services.
• Work with business stakeholders to translate requirements into technical solutions.
• Mentor engineering teams and provide technical leadership.

Required Skills

• Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse, OneLake)
• Azure Data Engineering
• Power BI
• Azure AI Services / Azure OpenAI
• Data Architecture & Data Modeling
• SQL, Python
• Azure DevOps, CI/CD
• Strong stakeholder management and solution design experience
• 
  

Preferred: Experience in Capital Markets or Financial Services and Microsoft Azure/Fabric certifications.

NOTE: One technical round is mandatory to be taken F2F from office.