Data Steward at Infogain · Delhi, Gurugram, Noida, Bengaluru (Bangalore), Mumbai, Pune · 7 - 8 years · ₹15L - ₹16L / yr · Posted 7 Sep 2021
Python- Data Steward :
Data Steward will collaborate and work closely within the group software engineering and business division. Data Steward has overall accountability for the group's / Divisions overall data and reporting posture by responsibly managing data assets, data lineage, and data access, supporting sound data analysis. This role requires focus on data strategy, execution, and support for projects, programs, application enhancements, and production data fixes. Makes well-thought-out decisions on complex or ambiguous data issues and establishes the data stewardship and information management strategy and direction for the group. Effectively communicates to individuals at various levels of the technical and business communities. This individual will become part of the corporate Data Quality and Data management/entity resolution team supporting various systems across the board.
Primary Responsibilities:
- Responsible for data quality and data accuracy across all group/division delivery initiatives.
- Responsible for data analysis, data profiling, data modeling, and data mapping capabilities.
- Responsible for reviewing and governing data queries and DML.
- Accountable for the assessment, delivery, quality, accuracy, and tracking of any production data fixes.
- Accountable for the performance, quality, and alignment to requirements for all data query design and development.
- Responsible for defining standards and best practices for data analysis, modeling, and queries.
- Responsible for understanding end-to-end data flows and identifying data dependencies in support of delivery, release, and change management.
- Responsible for the development and maintenance of an enterprise data dictionary that is aligned to data assets and the business glossary for the group responsible for the definition and maintenance of the group's data landscape including overlays with the technology landscape, end-to-end data flow/transformations, and data lineage.
- Responsible for rationalizing the group's reporting posture through the definition and maintenance of a reporting strategy and roadmap.
- Partners with the data governance team to ensure data solutions adhere to the organization’s data principles and guidelines.
- Owns group's data assets including reports, data warehouse, etc.
- Understand customer business use cases and be able to translate them to technical specifications and vision on how to implement a solution.
- Accountable for defining the performance tuning needs for all group data assets and managing the implementation of those requirements within the context of group initiatives as well as steady-state production.
- Partners with others in test data management and masking strategies and the creation of a reusable test data repository.
- Responsible for solving data-related issues and communicating resolutions with other solution domains.
- Actively and consistently support all efforts to simplify and enhance the Clinical Trial Predication use cases.
- Apply knowledge in analytic and statistical algorithms to help customers explore methods to improve their business.
- Contribute toward analytical research projects through all stages including concept formulation, determination of appropriate statistical methodology, data manipulation, research evaluation, and final research report.
- Visualize and report data findings creatively in a variety of visual formats that appropriately provide insight to the stakeholders.
- Achieve defined project goals within customer deadlines; proactively communicate status and escalate issues as needed.
Additional Responsibilities:
- Strong understanding of the Software Development Life Cycle (SDLC) with Agile Methodologies
- Knowledge and understanding of industry-standard/best practices requirements gathering methodologies.
- Knowledge and understanding of Information Technology systems and software development.
- Experience with data modeling and test data management tools.
- Experience in the data integration project • Good problem solving & decision-making skills.
- Good communication skills within the team, site, and with the customer
Knowledge, Skills and Abilities
- Technical expertise in data architecture principles and design aspects of various DBMS and reporting concepts.
- Solid understanding of key DBMS platforms like SQL Server, Azure SQL
- Results-oriented, diligent, and works with a sense of urgency. Assertive, responsible for his/her own work (self-directed), have a strong affinity for defining work in deliverables, and be willing to commit to deadlines.
- Experience in MDM tools like MS DQ, SAS DM Studio, Tamr, Profisee, Reltio etc.
- Experience in Report and Dashboard development
- Statistical and Machine Learning models
- Python (sklearn, numpy, pandas, genism)
- Nice to Have:
- 1yr of ETL experience
- Natural Language Processing
- Neural networks and Deep learning
- xperience in keras,tensorflow,spacy, nltk, LightGBM python library
Interaction : Frequently interacts with subordinate supervisors.
Education : Bachelor’s degree, preferably in Computer Science, B.E or other quantitative field related to the area of assignment. Professional certification related to the area of assignment may be required
Experience : 7 years of Pharmaceutical /Biotech/life sciences experience, 5 years of Clinical Trials experience and knowledge, Excellent Documentation, Communication, and Presentation Skills including PowerPoint
Shubham Vishwakarma
Full Stack Developer - Averlon
About Infogain
About
Company social profiles
Similar jobs (10)
We are hiring a Senior Data Governance Manager with 5+ years of data-management experience to define and run enterprise data governance policy, quality, metadata, lineage, and cataloging so the business can trust and safely use its data.
Key Responsibilities
• Define and enforce data governance policies and standards
• Own data quality frameworks, monitoring, and remediation
• Manage metadata, data lineage, and cataloging
• Drive master data management (MDM) practices
• Ensure compliance with privacy/regulatory requirements
• Align business and technical stakeholders on standards
Mandatory Skills
• 5+ years in data management with governance ownership
• Data governance frameworks and policy
• Data quality and master data management
• Metadata management and data cataloging
• Strong SQL and data-platform understanding
• Stakeholder alignment and compliance
Nice to Have: Collibra/Informatica/Alation; cloud data platforms (Snowflake, Azure, GCP)
PythonWe are looking for a dynamic Data Engineer to join our team of technology enthusiasts. You will leverage data to drive strategic decision-making and pioneering solutions, working with complex datasets, collaborating closely with stakeholders, and transforming data into actionable insights to drive innovation.
Qualifications and Skills:
- Minimum 4 years of experience as a Data Engineer
- Hands-on experience with Azure cloud-based data solutions
- Fabric experience is a must – designing, implementing, and managing data workflows and pipelines
- Expertise in database design and management, including SQL databases such as SQL Server
- Proficient in ETL (Extract, Transform, Load) design for data integration and processing
- Strong knowledge of data modeling principles and techniques
- Experience with Azure Data Factory (ADF) for orchestrating data workflows
- Ability to analyze and translate data into actionable insights, reports, and visualizations
- Proficiency in Power BI for reporting and data visualization
Desirable Skills:
- Experience with Power BI Report Builder / Reporting Services
- Knowledge of statistical analysis or Data Science
- Experience within the UK Insurance industry is a plus
- Python or R coding skills
Responsibilities:
- Implement efficient data exchange between internal and external systems to increase efficiency and reduce re-keying and translation errors
- Support the Broking business by developing high-quality information resources, ensuring data availability and accessibility for decision-making
- Engineer data inputs and outputs from core applications and semi-structured remote service data through data syncs between data lake, ODS (SQL database), and leveraging Fabric and ADF
- Perform data engineering tasks including ingestion, cleansing, and collation from a wide range of internal and external sources
- Implement different methods of streaming data and create reconciliations for datasets
- Build analytical models to support reporting and analytics
- Collaborate with an agile delivery team to work on the backlog of specified work
Data Analytics
LeadershipKey Responsibilities
- Lead end-to-end data migration initiatives, including assessment, planning, mapping, transformation, validation, and reconciliation.
- Define and implement data governance frameworks, standards, policies, and processes.
- Design and manage data solutions using Microsoft Azure Data Services.
- Lead development of BI dashboards, reports, KPIs, and analytics solutions.
- Work with business and technical stakeholders to understand reporting and data requirements.
- Develop and maintain data models, data pipelines, ETL/ELT processes, and reporting architecture.
- Ensure data quality, consistency, integrity, security, and compliance throughout migration and reporting processes.
- Identify data risks, dependencies, gaps, and migration challenges and drive their resolution.
- Establish data validation and reconciliation mechanisms to ensure migration accuracy.
- Provide technical leadership and guidance to data engineers, BI developers, and other project team members.
- Collaborate with application, cloud, infrastructure, and business teams during project implementation.
- Monitor data migration and BI deliverables against project timelines, quality standards, and business objectives.
- Prepare technical documentation, data dictionaries, mapping documents, governance guidelines, and project reports.
Required Skills & Experience
- 7+ years of experience in data, migration, BI, or related technology roles.
- Strong experience working on software/IT projects and managing data-related workstreams.
- Hands-on experience with Microsoft Azure Data Services.
- Strong understanding of data migration methodologies, ETL/ELT, data transformation, and reconciliation.
- Experience in Data Governance, Data Quality, Master Data, Metadata Management, and Data Security.
- Strong experience with BI reporting and dashboard development.
- Good understanding of SQL and relational databases.
- Experience with Power BI and data visualization is highly desirable.
- Knowledge of Azure services such as Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, or equivalent.
- Strong understanding of data architecture and data lifecycle management.
- Excellent stakeholder management, communication, analytical, and problem-solving skills.
PythonJob Summary
The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements and align with best practices. (1.) Key Responsibilities
1. Lead and manage end-to-end data engineering projects using azure data factory, azure databricks, sql, oracle pl/sql, and python.
2. Collaborate with stakeholders to gather and understand requirements for data pipelines and analytics solutions.
3. Design and develop etl processes, data models, and data integration solutions.
4. Provide technical guidance and mentorship to the team members.
5. Ensure data quality, data governance, and data security standards are maintained throughout the project lifecycle.
6. Troubleshoot and optimize data pipelines and processes for performance and efficiency.
7. Stay updated on the latest trends and technologies in data engineering and contribute to continuous improvement efforts.
Skill Requirements
1. Proficiency in azure data factory (adf) and azure databricks for building and managing data pipelines.
2. Strong experience with sql and oracle pl/sql for data querying and manipulation.
3. Advanced programming skills in python for scripting and data processing tasks.
4. Knowledge of data modeling, data warehousing concepts, and database design principles.
5. Ability to work in a collaborative team environment and communicate effectively with stakeholders.
6. Strong analytical and problem-solving skills with attention to detail.
7. Experience in data visualization tools and techniques is a plus.
Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle PL/SQL, or Python are advantageous.
Skill (Primary)
Data Fabric-Azure-Azure Data Factory (ADF)
Azure Data Factory and Azure Databricks, processing 5 million+ records/week from 4+ source systems into a governed Lakehouse.
Job Description
• Design and Implement Data Solutions: Lead the design, development, and implementation of scalable and secure Azure-
based data platforms, ensuring integration with various data sources and business systems. Deliver at least 2 major
projects every year with a focus on data engineering best practices.
• Optimize Data Pipelines: Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Databricks, and
Azure Synapse, with an emphasis on automating data workflows. Achieve a 20% reduction in pipeline execution times
within the first 6 months.
• Cloud Infrastructure Management: Manage and maintain the Azure data environment, ensuring high availability, disaster
recovery, and cost optimization. Track and improve system uptime to exceed 99.9% reliability.
• Collaborate with Cross-Functional Teams: Partner with data scientists, data analysts, and business stakeholders to translate
business requirements into efficient data solutions. Facilitate at least 3 collaborative sessions per quarter to address key
business use cases.
• Ensure Data Security & Compliance: Implement data security measures, ensuring compliance with industry regulations
(GDPR, HIPAA, etc.) and company policies. Achieve and maintain full compliance in all data environments within the first
quarter of onboarding.
• Continuous Learning & Knowledge Sharing: Stay up-to-date with emerging Azure technologies, and mentor junior
engineers to promote knowledge sharing. Complete 1 Azure certification annually and conduct at least 2 internal
knowledge-sharing sessions per year.
• Sound knowledge of data governance practices, data quality management, and data security principles.
• Play a pivotal role in shaping our organization's data-driven journey, driving innovation through data analytics and insights.
• Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage
services (such as Azure Data Lake Storage, Azure SQL Database, etc.), data processing services (such as Azure Data Bricks,
Azure Synapse, etc.) and data visualization (PowerBI, Qlik, etc.) & integration services (Data API builder, logic apps, etc.)
• Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for
continuous improvement.
• Collaborate with DevOps teams to automate deployment, configuration, and monitoring processes using Azure DevOps,
PowerShell, or other relevant tools.
• Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting
new technologies or features to enhance the data platform.
• Document technical designs, procedures, and guidelines for data platform engineering and operations
Knowledge, Skills & Experience
Job Experience • Bachelor's degree in Computer Science, Engineering, or a related field. Advanced
degree preferred.
• Proven 6-10 years experience in playing platform engineer or admin role
• Experience with big data technologies such as Apache Spark, Hadoop, or similar
frameworks.
• Solid understanding of cloud computing concepts and experience with cloud
infrastructure management and provisioning.
• Solid understanding of network security concepts and technologies (such as
firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security
concepts and technologies (such as access controls, encryption, observability,
privacy laws/regulations, etc.)
• Experience in a Retail setup is preferred.
Required Skills The position will require someone with the following:
• Strategic Planning
Public
• Communication and Collaboration
• Problem Solving Skills A/B testing & experimentation
• SQL, BI tools, and storytelling with data
PythonRoles & Responsibilities
- Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration
of enterprise-wide data from diverse sources
• Build and optimize data engineering workflows using Databricks and PySpark
• Write efficient, high-performance SQL for data transformation and analysis
• Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing,
data models, and pipelines
• Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the
development lifecycle
• Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production
environments with proper change control processes
• Collaborate with cross-functional teams to translate business requirements into scalable data solutions
• Ensure data quality, reliability, and performance across all pipelines and platforms
Ideal Candidate
1Strong Azure Databricks Engineer / Senior Data Engineer Profile
2Mandatory (Experience 1) – Must have minimum 8+ years of overall experience in Data Engineering, Data Development, or related data technology roles, with strong hands-on experience in enterprise data pipeline development.
3Mandatory (Experience 2) – Must have strong hands-on experience with Azure Databricks, including development and optimization of scalable data engineering workflows using Databricks and PySpark.
4Mandatory (Experience 3) – Must have strong hands-on proficiency in PySpark/Python and SQL, with proven experience developing complex data transformations, processing workflows, and performance-optimized queries.
5Mandatory (Experience 4) – Must have hands-on experience with Azure Data Factory (ADF) for designing, developing, and orchestrating end-to-end data pipelines and integrating data from multiple sources.
6Mandatory (Experience 5) – Must have strong experience working on the Azure Cloud platform and associated data services, with solid understanding of data warehousing, data modeling, pipeline architecture, and enterprise data solutions.
7Mandatory (Experience 6) – Must have hands-on experience implementing CI/CD using Azure DevOps, including deployment and release management across development, QA, and production environments.
8Mandatory (Experience 7) – Must have proven technical leadership experience, including code reviews, enforcing development best practices, mentoring developers, and providing technical guidance to a data engineering team.
9Mandatory (Notice Period) – Immediate joiners or candidates who can join within 15 days.
10Mandatory (Note) - The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location.
Example:
We are looking for an experienced Data Architect to design, develop, and manage the organization's enterprise data architecture. The candidate will be responsible for building scalable data platforms, ensuring data quality and governance, and supporting business analytics through modern data solutions.
Experience Required
Mention the minimum years of experience.
Example:
- Minimum 12 years of experience in Data Architecture, Data Engineering, or related fields.
- 5+ years of experience in the Banking/Financial Services domain is preferred.
Educational Qualification
Mention the required degree.
Example:
- BE/BTech in Computer Science, Information Technology, Software Engineering, Electronics & Communication Engineering, or equivalent.
- OR MCA/MTech/MSc in Computer Science, IT, or related disciplines.
- MBA is preferred.
Technical Skills
List the skills the candidate must have.
Example:
- AWS, Azure, or GCP
- Data Warehousing (DWH)
- ETL/ELT
- Database Management
- Data Modeling
- Data Analytics
- Data Lakes
- Data Governance
Key Responsibilities
Convert the points you received into simple action statements.
Example:
- Design and maintain enterprise data architecture.
- Develop data warehouses and data lakes.
- Define data standards and governance policies.
- Ensure data quality and security.
- Design ETL/ELT processes.
- Integrate data from multiple systems.
- Plan and execute data migration projects.
- Review existing data architecture and recommend improvements.
- Provide technical guidance to project teams.
- Evaluate new data technologies and tools.
Preferred Skills
These are not mandatory but are an advantage.
Example:
- Banking domain experience
- Strong analytical and problem-solving skills
- Good communication skills
- Leadership and stakeholder management
- Experience mentoring technical teams
PostgreSQL10+ years of experience in Data Architecture, Data Engineering, or Data Platforms
• Strong expertise in IBM DB2 / On-Prem Relational Databases
• Strong expertise in PostgreSQL
• Hands-on experience with the Azure Data Ecosystem, including:
▪ Azure Data Factory (ADF)
▪ Azure Data Lake Storage Gen2 (ADLS Gen2)
▪ Azure Databricks / Synapse Analytics
▪ Azure Event Hub / Service Bus
▪ Azure Functions
Dear Candidate,
Greeting from NAM Info Pvt Ltd.
We have a role for Data Engineer position with NAM Info.
This role will be permanent with NAM info and deploy to client
location NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA.
Work Mode: WORK FROM OFFICE
A decent hike can be provided based on current CTC
Interview Mode: Virtual
Role Descriptions:
Exp Range: 7 - 10 years
City Locations: NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA
Key Responsibilities*
Role: Data Engineer
Location: ~NEW DELHI~CHENNAI~HYDERABAD~PUNE~KOLKATA
Skills: Digital: Databricks, Azure Data Factory
Experience Required: 8-10
Descriptions:
Good information and sound knowledge in Azure Synapse Analytics Azure Data Factory (ADF)Big Data technologies and data processing frameworks Azure Data Warehouse and associated Azure data platform services Data integration| data modelling| and performance optimization
Desire candidate
- Candidate should have valid PF.
Regards,
NAM Info
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon