9+ Teradata Jobs in India

Overview:

We are seeking a talented and experienced GCP Data Engineer with strong expertise in Teradata, ETL, and Data Warehousing to join our team. As a key member of our Data Engineering team, you will play a critical role in developing and maintaining data pipelines, optimizing ETL processes, and managing large-scale data warehouses on the Google Cloud Platform (GCP).

Responsibilities:

• Design, implement, and maintain scalable ETL pipelines on GCP (Google Cloud Platform).
• Develop and manage data warehouse solutions using Teradata and cloud-based technologies (BigQuery, Cloud Storage, etc.).
• Build and optimize high-performance data pipelines for real-time and batch data processing.
• Integrate, transform, and load large datasets into GCP-based data lakes and data warehouses.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Write efficient, clean, and reusable code for ETL processes and data workflows.
• Ensure data quality, consistency, and integrity across all pipelines and storage solutions.
• Implement data governance practices and ensure security and compliance of data processes.
• Monitor and troubleshoot data pipeline performance and resolve issues proactively.
• Participate in the design and implementation of scalable data architectures using GCP services like BigQuery, Cloud Dataflow, and Cloud Pub/Sub.
• Optimize and automate data workflows for continuous improvement.
• Maintain up-to-date documentation of data pipeline architectures and processes.

Requirements:

Technical Skills:

• Google Cloud Platform (GCP): Extensive experience with BigQuery, Cloud Storage, Cloud Dataflow, and Cloud Composer.
• ETL Tools: Expertise in building ETL pipelines using tools such as Apache NiFi, Apache Beam, or custom Python-based scripts.
• Data Warehousing: Strong experience working with Teradata for data warehousing, including data modeling, schema design, and performance tuning.
• SQL: Advanced proficiency in SQL and relational databases, particularly in the context of Teradata and GCP environments.
• Programming: Proficient in Python, Java, or Scala for building and automating data processes.
• Data Architecture: Knowledge of best practices in designing scalable data architectures for both structured and unstructured data.

Experience:

• Proven experience as a Data Engineer, with a focus on building and managing ETL pipelines and data warehouse solutions.
• Hands-on experience in data modeling and working with complex, high-volume data in a cloud-based environment.
• Experience with data migration from on-premises to cloud environments (Teradata to GCP).
• Familiarity with Data Lake concepts and technologies.
• Experience with version control systems like Git and working in Agile environments.
• Knowledge of CI/CD and automation processes in data engineering.

Soft Skills:

• Strong problem-solving and troubleshooting skills.
• Excellent communication skills, both verbal and written, for interacting with technical and non-technical teams.
• Ability to work collaboratively in a fast-paced, cross-functional team environment.
• Strong attention to detail and ability to prioritize tasks.

Preferred Qualifications:

• Experience with other GCP tools such as Dataproc, Bigtable, Cloud Functions.
• Knowledge of Terraform or similar infrastructure-as-code tools for managing cloud resources.
• Familiarity with data governance frameworks and data privacy regulations.
• Certifications in Google Cloud or Teradata are a plus.

Benefits:

• Competitive salary and performance-based bonuses.
• Health, dental, and vision insurance.
• 401(k) with company matching.
• Paid time off and flexible work schedules.
• Opportunities for professional growth and development.

Responsibilities:

• Designing Hive/HCatalog data model includes creating table definitions, file formats, compression techniques for Structured & Semi-structured data processing

• Implementing Spark processing based ETL frameworks

• Implementing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

• Modifying the Informatica-Teradata & Unix based data pipeline

• Enhancing the Talend-Hive/Spark & Unix based data pipelines

• Develop and Deploy Scala/Python based Spark Jobs for ETL processing

• Strong SQL & DWH concepts.

Preferred Background:

• Function as integrator between business needs and technology solutions, helping to create technology solutions to meet clients’ business needs

• Lead project efforts in defining scope, planning, executing, and reporting to stakeholders on strategic initiatives

• Understanding of EDW system of business and creating High level design document and low level implementation document

• Understanding of Big Data Lake system of business and creating High level design document and low level implementation document

• Designing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

RequiredSkills:

• Minimum of 4-6 years of experience in data modeling (including conceptual, logical and physical data models. • 2-3 years of experience inExtraction, Transformation and Loading ETLwork using data migration tools like Talend, Informatica, Datastage, etc. • 4-6 years of experience as a database developerinOracle, MS SQLor another enterprise database with a focus on building data integration process • Candidate should haveanyNoSqltechnology exposure preferably MongoDB. • Experience in processing large data volumes indicated by experience with BigDataplatforms (Teradata, Netezza, Vertica or Cloudera, Hortonworks, SAP HANA, Cassandra, etc.). • Understanding of data warehousing concepts and decision support systems.

• Ability to deal with sensitive and confidential material and adhere to worldwide data security and • Experience writing documentation for design and feature requirements. • Experience developing data-intensive applications on cloud-based architectures and infrastructures such as AWS, Azure etc. • Excellent communication and collaboration skills.

• Must have 4 to 7 years of experience in ETL Design and Development using Informatica Components.
• Should have extensive knowledge in Unix shell scripting.
• Understanding of DW principles (Fact, Dimension tables, Dimensional Modelling and Data warehousing concepts).
• Research, development, document and modification of ETL processes as per data architecture and modeling requirements.
• Ensure appropriate documentation for all new development and modifications of the ETL processes and jobs.
• Should be good in writing complex SQL queries.

• • Selected candidates will be provided training opportunities on one or more of following: Google Cloud, AWS, DevOps Tools, Big Data technologies like Hadoop, Pig, Hive, Spark, Sqoop, Flume and
• Kafka would get chance to be part of the enterprise-grade implementation of Cloud and Big Data systems
• Will play an active role in setting up the Modern data platform based on Cloud and Big Data
• Would be part of teams with rich experience in various aspects of distributed systems and computing.

• Key responsibility is to design, develop & maintain efficient Data models for the organization maintained to ensure optimal query performance by the consumption layer.
• Developing, Deploying & maintaining a repository of UDXs written in Java / Python.
• Develop optimal Data Model design, analyzing complex distributed data deployments, and making recommendations to optimize performance basis data consumption patterns, performance expectations, the query is executed on the tables/databases, etc.
• Periodic Database health check and maintenance
• Designing collections in a no-SQL Database for efficient performance
• Document & maintain data dictionary from various sources to enable data governance
• Coordination with Business teams, IT, and other stakeholders to provide best-in-class data pipeline solutions, exposing data via APIs, loading in down streams, No-SQL Databases, etc
• Data Governance Process Implementation and ensuring data security

Requirements

• Extensive working experience in Designing & Implementing Data models in OLAP Data Warehousing solutions (Redshift, Synapse, Snowflake, Teradata, Vertica, etc).
• Programming experience using Python / Java.
• Working knowledge in developing & deploying User-defined Functions (UDXs) using Java / Python.
• Strong understanding & extensive working experience in OLAP Data Warehousing (Redshift, Synapse, Snowflake, Teradata, Vertica, etc) architecture and cloud-native Data Lake (S3, ADLS, BigQuery, etc) Architecture.
• Strong knowledge in Design, Development & Performance tuning of 3NF/Flat/Hybrid Data Model.
• Extensive technical experience in SQL including code optimization techniques.
• Strung knowledge of database performance and tuning, troubleshooting, and tuning.
• Knowledge of collection design in any No-SQL DB (DynamoDB, MongoDB, CosmosDB, etc), along with implementation of best practices.
• Ability to understand business functionality, processes, and flows.
• Good combination of technical and interpersonal skills with strong written and verbal communication; detail-oriented with the ability to work independently.
• Any OLAP DWH DBA Experience and User Management will be added advantage.
• Knowledge in financial industry-specific Data models such as FSLDM, IBM Financial Data Model, etc will be added advantage.
• Experience in Snowflake will be added advantage.
• Working experience in BFSI/NBFC & data understanding of Loan/Mortgage data will be added advantage.

Functional knowledge

• Data Governance & Quality Assurance
• Modern OLAP Database Architecture & Design
• Linux
• Data structures, algorithm & data modeling techniques
• No-SQL database architecture
• Data Security

• Experience - 6-10 years
• Key Skills for Software Developer C++, Linux with SQL:
• - Looking only for candidates who can join immediately or max 10 day
• - should be able to work independently with no handholding
• - the ability to work with C/C++ code on Windows/Linux platforms
• - Database knowledge of MSSQL, Oracle, MySQL/MariaDB, ideally other ones too: Saphana, Teradata, Postgres.
• - Ability to work on their own fixing defects
• - should be able to understand secure coding practices
• - should have the Ability to work independently and with the team across different time zones

• Experience  4 - 8 years
• Key Skills for Software Developer C++, Linux :
• - Looking only for candidates who can join immediately or max 10 day
• - should be able to work independently with no handholding
• - the ability to work with C/C++ code on Windows/Linux platforms
• - Database knowledge of MSSQL, Oracle, MySQL/MariaDB, ideally other ones too: Saphana, Teradata, Postgres.
• - Ability to work on their own fixing defects
• - should be able to understand secure coding practices
• - should have the Ability to work independently and with the team across different time zones