36+ ETL Jobs in Pune | ETL Job openings in Pune

Here is the Job Description - 

Location -- Viman Nagar, Pune

Mode - 5 Days Working

Required Tech Skills:

 ● Strong at PySpark, Python

 ● Good understanding of Data Structure 

 ● Good at SQL query/optimization 

 ● Strong fundamentals of OOPs programming 

 ● Good understanding of AWS Cloud, Big Data. 

 ● Data Lake, AWS Glue, Athena, S3, Kinesis, SQL/NoSQL DB  

We are seeking a highly skilled and experienced Offshore Data Engineer . The role involves designing, implementing, and testing data pipelines and products.

Qualifications & Experience:

bachelor's or master's degree in computer science, Information Systems, or a related field.

5+ years of experience in data engineering, with expertise in data architecture and pipeline development.

☁️ Proven experience with GCP, Big Query, Databricks, Airflow, Spark, DBT, and GCP Services.

️ Hands-on experience with ETL processes, SQL, PostgreSQL, MySQL, MongoDB, Cassandra.

Strong proficiency in Python and data modelling.

Experience in testing and validation of data pipelines.

Preferred: Experience with eCommerce systems, data visualization tools (Tableau, Looker), and cloud certifications.

If you meet the above criteria and are interested, please share your updated CV along with the following details:

Total Experience:

Current CTC:

Expected CTC:

Current Location:

Preferred Location:

Notice Period / Last Working Day (if serving notice):

⚠️ Kindly share your details only if you have not applied recently or are not currently in the interview process for any open roles at Xebia.

Looking forward to your response!

We are seeking a highly skilled and experienced Power BI Lead / Architect to join our growing team. The ideal candidate will have a strong understanding of data warehousing, data modeling, and business intelligence best practices. This role will be responsible for leading the design, development, and implementation of complex Power BI solutions that provide actionable insights to key stakeholders across the organization.

Location - Pune (Hybrid 3 days)

Responsibilities:

Lead the design, development, and implementation of complex Power BI dashboards, reports, and visualizations.

Develop and maintain data models (star schema, snowflake schema) for optimal data analysis and reporting.

Perform data analysis, data cleansing, and data transformation using SQL and other ETL tools.

Collaborate with business stakeholders to understand their data needs and translate them into effective and insightful reports.

Develop and maintain data pipelines and ETL processes to ensure data accuracy and consistency.

Troubleshoot and resolve technical issues related to Power BI dashboards and reports.

Provide technical guidance and mentorship to junior team members.

Stay abreast of the latest trends and technologies in the Power BI ecosystem.

Ensure data security, governance, and compliance with industry best practices.

Contribute to the development and improvement of the organization's data and analytics strategy.

May lead and mentor a team of junior Power BI developers.

Qualifications:

8-12 years of experience in Business Intelligence and Data Analytics.

Proven expertise in Power BI development, including DAX, advanced data modeling techniques.

Strong SQL skills, including writing complex queries, stored procedures, and views.

Experience with ETL/ELT processes and tools.

Experience with data warehousing concepts and methodologies.

Excellent analytical, problem-solving, and communication skills.

Strong teamwork and collaboration skills.

Ability to work independently and proactively.

Bachelor's degree in Computer Science, Information Systems, or a related field preferred.

Experience: 4+ years.

Location: Vadodara & Pune

Skills Set- Snowflake, Power Bi, ETL, SQL, Data Pipelines

What you'll be doing:

• Develop, implement, and manage scalable Snowflake data warehouse solutions using advanced features such as materialized views, task automation, and clustering.
• Design and build real-time data pipelines from Kafka and other sources into Snowflake using Kafka Connect, Snowpipe, or custom solutions for streaming data ingestion.
• Create and optimize ETL/ELT workflows using tools like DBT, Airflow, or cloud-native solutions to ensure efficient data processing and transformation.
• Tune query performance, warehouse sizing, and pipeline efficiency by utilizing Snowflakes Query Profiling, Resource Monitors, and other diagnostic tools.
• Work closely with architects, data analysts, and data scientists to translate complex business requirements into scalable technical solutions.
• Enforce data governance and security standards, including data masking, encryption, and RBAC, to meet organizational compliance requirements.
• Continuously monitor data pipelines, address performance bottlenecks, and troubleshoot issues using monitoring frameworks such as Prometheus, Grafana, or Snowflake-native tools.
• Provide technical leadership, guidance, and code reviews for junior engineers, ensuring best practices in Snowflake and Kafka development are followed.
• Research emerging tools, frameworks, and methodologies in data engineering and integrate relevant technologies into the data stack.

What you need:

Basic Skills:

• 3+ years of hands-on experience with Snowflake data platform, including data modeling, performance tuning, and optimization.
• Strong experience with Apache Kafka for stream processing and real-time data integration.
• Proficiency in SQL and ETL/ELT processes.
• Solid understanding of cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with scripting languages like Python, Shell, or similar for automation and data integration tasks.
• Familiarity with tools like dbt, Airflow, or similar orchestration platforms.
• Knowledge of data governance, security, and compliance best practices.
• Strong analytical and problem-solving skills with the ability to troubleshoot complex data issues.
• Ability to work in a collaborative team environment and communicate effectively with cross-functional teams

Responsibilities:

• Design, develop, and maintain Snowflake data warehouse solutions, leveraging advanced Snowflake features like clustering, partitioning, materialized views, and time travel to optimize performance, scalability, and data reliability.
• Architect and optimize ETL/ELT pipelines using tools such as Apache Airflow, DBT, or custom scripts, to ingest, transform, and load data into Snowflake from sources like Apache Kafka and other streaming/batch platforms.
• Work in collaboration with data architects, analysts, and data scientists to gather and translate complex business requirements into robust, scalable technical designs and implementations.
• Design and implement Apache Kafka-based real-time messaging systems to efficiently stream structured and semi-structured data into Snowflake, using Kafka Connect, KSQL, and Snow pipe for real-time ingestion.
• Monitor and resolve performance bottlenecks in queries, pipelines, and warehouse configurations using tools like Query Profile, Resource Monitors, and Task Performance Views.
• Implement automated data validation frameworks to ensure high-quality, reliable data throughout the ingestion and transformation lifecycle.
• Pipeline Monitoring and Optimization: Deploy and maintain pipeline monitoring solutions using Prometheus, Grafana, or cloud-native tools, ensuring efficient data flow, scalability, and cost-effective operations.
• Implement and enforce data governance policies, including role-based access control (RBAC), data masking, and auditing to meet compliance standards and safeguard sensitive information.
• Provide hands-on technical mentorship to junior data engineers, ensuring adherence to coding standards, design principles, and best practices in Snowflake, Kafka, and cloud data engineering.
• Stay current with advancements in Snowflake, Kafka, cloud services (AWS, Azure, GCP), and data engineering trends, and proactively apply new tools and methodologies to enhance the data platform. 

Role: Ab Initio Developer

Experience: 2.5 (mandate) - 8 years

Skills: Ab Initio Development

Location: Chennai/Bangalore/Pune

only Immediate to 15 days joiners

should be available for in person interview only

Its a long term contract role with IBM and Arnold is the payrolling company.

JOB DESCRIPTION:

We are seeking a skilled Ab Initio Developer to join our dynamic team and contribute to the development and maintenance of critical data integration solutions. As an Ab Initio Developer, you will be responsible for designing, developing, and implementing robust and efficient data pipelines using Ab Initio's powerful ETL capabilities.

Key Responsibilities:

·      Design, develop, and implement complex data integration solutions using Ab Initio's graphical interface and command-line tools.

·      Analyze complex data requirements and translate them into effective Ab Initio designs.

·      Develop and maintain efficient data pipelines, including data extraction, transformation, and loading processes.

·      Troubleshoot and resolve technical issues related to Ab Initio jobs and data flows.

·      Optimize performance and scalability of Ab Initio jobs.

·      Collaborate with business analysts, data analysts, and other team members to understand data requirements and deliver solutions that meet business needs.

·      Stay up-to-date with the latest Ab Initio technologies and industry best practices.

Required Skills and Experience:

·      2.5 to 8 years of hands-on experience in Ab Initio development.

·      Strong understanding of Ab Initio components, including Designer, Conductor, and Monitor.

·      Proficiency in Ab Initio's graphical interface and command-line tools.

·      Experience in data modeling, data warehousing, and ETL concepts.

·      Strong SQL skills and experience with relational databases.

·      Excellent problem-solving and analytical skills.

·      Ability to work independently and as part of a team.

·      Strong communication and documentation skills.

Preferred Skills:

·      Experience with cloud-based data integration platforms.

·      Knowledge of data quality and data governance concepts.

·      Experience with scripting languages (e.g., Python, Shell scripting).

·      Certification in Ab Initio or related technologies.

Job Description :

Job Title : Data Engineer

Location : Pune (Hybrid Work Model)

Experience Required : 4 to 8 Years

Role Overview :

We are seeking talented and driven Data Engineers to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, PySpark, and SQL. You will be responsible for designing, building, and maintaining scalable data pipelines and systems that empower our business intelligence and analytics initiatives.

Key Responsibilities:

• Develop, optimize, and maintain ETL pipelines and data workflows.
• Design and implement scalable data solutions using Python, PySpark, and SQL.
• Collaborate with cross-functional teams to gather and analyze data requirements.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Monitor and troubleshoot data pipelines to ensure reliability and performance.
• Work on hybrid data environments involving on-premise and cloud-based systems.
• Assist in the deployment and maintenance of big data solutions.

Required Skills and Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or related field.
• 4 to 8 Years of experience in Data Engineering or related roles.
• Proficiency in Python and PySpark for data processing and analysis.
• Strong SQL skills with experience in writing complex queries and optimizing performance.
• Familiarity with data pipeline tools and frameworks.
• Knowledge of cloud platforms such as AWS, Azure, or GCP is a plus.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.

Preferred Qualifications:

• Experience with big data technologies like Hadoop, Hive, or Spark.
• Familiarity with data visualization tools and techniques.
• Knowledge of CI/CD pipelines and DevOps practices in a data engineering context.

Work Model:

• This position follows a hybrid work model, with candidates expected to work from the Pune office as per business needs.

Why Join Us?

• Opportunity to work with cutting-edge technologies.
• Collaborative and innovative work environment.
• Competitive compensation and benefits.
• Clear career progression and growth opportunities.

• Bachelor's degree required, or higher education level, or foreign equivalent, preferably in area wit
• At least 5 years experience in Duck Creek Data Insights as Technical Architect/Senior Developer.
• Strong Technical knowledge on SQL databases, MSBI.
• Should have strong hands-on knowledge on Duck Creek Insight product, SQL Server/DB level configuration, T-SQL, XSL/XSLT, MSBI etc
• Well versed with Duck Creek Extract Mapper Architecture
• Strong understanding of Data Modelling, Data Warehousing, Data Marts, Business Intelligence with ability to solve business problems
• Strong understanding of ETL and EDW toolsets on the Duck Creek Data Insights
• Strong knowledge on Duck Creek Insight product overall architecture flow, Data hub, Extract mapper etc
• Understanding of data related to business application areas policy, billing, and claims business solutions
• Minimum 4 to 7 year working experience on Duck Creek Insights product
• Strong Technical knowledge on SQL databases, MSBI
• Preferable having experience in Insurance domain
• Preferable experience in Duck Creek Data Insights
• Experience specific to Duck Creek would be an added advantage
• Strong knowledge of database structure systems and data mining
• Excellent organisational and analytical abilities
• Outstanding problem solver

Job Description:

We are currently seeking a talented and experienced SAP SF Data Migration Specialist to join our team and drive the successful migration of SAP S/4 from SAP ECC.

As the SAP SF Data Migration Specialist, you will play a crucial role in overseeing the design, development, and implementation of data solutions within our SAP SF environment. You will collaborate closely with cross-functional teams to ensure data integrity, accuracy, and usability to support business processes and decision-making. 

About the Company:

We are a dynamic and innovative company committed to delivering exceptional solutions that empower our clients to succeed. With our headquarters in the UK and a global footprint across the US, Noida, and Pune in India, we bring a decade of expertise to every endeavour, driving real results. We take a holistic approach to project delivery, providing end-to-end services that encompass everything from initial discovery and design to implementation, change management, and ongoing support. Our goal is to help clients leverage the full potential of the Salesforce platform to achieve their business objectives.

What Makes VE3 The Best For You We think of your family as our family, no matter the shape or size. We offer maternity leaves, PF Fund Contributions, 5 days working week along with a generous paid time off program that benefits balance your work & personal life.

Requirements

Responsibilities:

• Lead the design and implementation of data migration strategies and solutions within SAP SF environments.
• Develop and maintain data migration plans, ensuring alignment with project timelines and objectives.
• Collaborate with business stakeholders to gather and analyse data requirements, ensuring alignment with business needs and objectives.
• Design and implement data models, schemas, and architectures to support SAP data structures and functionalities.
• Lead data profiling and analysis activities to identify data quality issues, gaps, and opportunities for improvement.
• Define data transformation rules and processes to ensure data consistency, integrity, and compliance with business rules and regulations.
• Manage data cleansing, enrichment, and standardization efforts to improve data quality and usability.
• Coordinate with technical teams to implement data migration scripts, ETL processes, and data loading mechanisms.
• Develop and maintain data governance policies, standards, and procedures to ensure data integrity, security, and privacy.
• Lead data testing and validation activities to ensure accuracy and completeness of migrated data.
• Provide guidance and support to project teams, including training, mentoring, and knowledge sharing on SAP data best practices and methodologies.
• Stay current with SAP data management trends, technologies, and best practices, and recommend innovative solutions to enhance data capabilities and performance.

Requirements:

• Bachelor’s degree in computer science, Information Systems, or related field; master’s degree preferred.
• 10+ years of experience in SAP and Non-SAP data management, with a focus on data migration, data modelling, and data governance.
• Have demonstrable experience as an SAP Data Consultant, ideally working across SAP SuccessFactors and non-SAP systems
• Highly knowledgeable and experienced in managing HR data migration projects in SAP SuccessFactors environments
• Demonstrate knowledge of how data aspects need to be considered within overall SAP solution design
• Manage the workstream activities and plan, including stakeholder management, engagement with the business and the production of governance documentation.
• Proven track record of leading successful SAP data migration projects from conception to completion.
• Excellent analytical, problem-solving, and communication skills, with the ability to collaborate effectively with cross-functional teams.
• Experience with SAP Activate methodologies preferred.
• SAP certifications in data management or related areas are a plus.
• Ability to work independently and thrive in a fast-paced, dynamic environment.
• Lead the data migration workstream, with a direct team of circa 5 resources in addition to other 3rd party and client resource.
• Work flexibly and remotely. Occasional UK travel will be required

Benefits

• Competitive salary and comprehensive benefits package.
• Opportunity to work in a dynamic and challenging environment on critical migration projects.
• Professional growth opportunities in a supportive and forward-thinking organization.
• Engagement with cutting-edge SAP technologies and methodologies in data migration.

TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and predictive quality. We have renowned reference customers, competent technology, a good research team from renowned Universities, and the award of a renowned AI prize (e.g., EU Horizon 2020) which makes Tvarit one of the most innovative AI companies in Germany and Europe. 

We are looking for a self-motivated person with a positive "can-do" attitude and excellent oral and written communication skills in English. 

We are seeking a skilled and motivated Data Engineer from the manufacturing Industry with over two years of experience to join our team. As a data engineer, you will be responsible for designing, building, and maintaining the infrastructure required for the collection, storage, processing, and analysis of large and complex data sets. The ideal candidate will have a strong foundation in ETL pipelines and Python, with additional experience in Azure and Terraform being a plus. This role requires a proactive individual who can contribute to our data infrastructure and support our analytics and data science initiatives. 

Skills Required 

• Experience in the manufacturing industry (metal industry is a plus)  
• 2+ years of experience as a Data Engineer 
• Experience in data cleaning & structuring and data manipulation 
• ETL Pipelines: Proven experience in designing, building, and maintaining ETL pipelines. 
• Python: Strong proficiency in Python programming for data manipulation, transformation, and automation. 
• Experience in SQL and data structures  
• Knowledge in big data technologies such as Spark, Flink, Hadoop, Apache and NoSQL databases. 
• Knowledge of cloud technologies (at least one) such as AWS, Azure, and Google Cloud Platform. 
• Proficient in data management and data governance  
• Strong analytical and problem-solving skills. 
• Excellent communication and teamwork abilities. 

Nice To Have 

• Azure: Experience with Azure data services (e.g., Azure Data Factory, Azure Databricks, Azure SQL Database). 
• Terraform: Knowledge of Terraform for infrastructure as code (IaC) to manage cloud. 

TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and predictive quality. We have renowned reference customers, competent technology, a good research team from renowned Universities, and the award of a renowned AI prize (e.g., EU Horizon 2020) which makes TVARIT one of the most innovative AI companies in Germany and Europe.

We are looking for a self-motivated person with a positive "can-do" attitude and excellent oral and written communication skills in English.

We are seeking a skilled and motivated senior Data Engineer from the manufacturing Industry with over four years of experience to join our team. The Senior Data Engineer will oversee the department’s data infrastructure, including developing a data model, integrating large amounts of data from different systems, building & enhancing a data lake-house & subsequent analytics environment, and writing scripts to facilitate data analysis. The ideal candidate will have a strong foundation in ETL pipelines and Python, with additional experience in Azure and Terraform being a plus. This role requires a proactive individual who can contribute to our data infrastructure and support our analytics and data science initiatives.

Skills Required:

• Experience in the manufacturing industry (metal industry is a plus)
• 4+ years of experience as a Data Engineer
• Experience in data cleaning & structuring and data manipulation
• Architect and optimize complex data pipelines, leading the design and implementation of scalable data infrastructure, and ensuring data quality and reliability at scale
• ETL Pipelines: Proven experience in designing, building, and maintaining ETL pipelines.
• Python: Strong proficiency in Python programming for data manipulation, transformation, and automation.
• Experience in SQL and data structures
• Knowledge in big data technologies such as Spark, Flink, Hadoop, Apache, and NoSQL databases.
• Knowledge of cloud technologies (at least one) such as AWS, Azure, and Google Cloud Platform.
• Proficient in data management and data governance
• Strong analytical experience & skills that can extract actionable insights from raw data to help improve the business.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.

Nice To Have:

• Azure: Experience with Azure data services (e.g., Azure Data Factory, Azure Databricks, Azure SQL Database).
• Terraform: Knowledge of Terraform for infrastructure as code (IaC) to manage cloud.
• Bachelor’s degree in computer science, Information Technology, Engineering, or a related field from top-tier Indian Institutes of Information Technology (IIITs).
• Benefits And Perks
• A culture that fosters innovation, creativity, continuous learning, and resilience
• Progressive leave policy promoting work-life balance
• Mentorship opportunities with highly qualified internal resources and industry-driven programs
• Multicultural peer groups and supportive workplace policies
• Annual workcation program allowing you to work from various scenic locations
• Experience the unique environment of a dynamic start-up

Why should you join TVARIT ?

Working at TVARIT, a deep-tech German IT startup, offers a unique blend of innovation, collaboration, and growth opportunities. We seek individuals eager to adapt and thrive in a rapidly evolving environment.

If this opportunity excites you and aligns with your career aspirations, we encourage you to apply today!

TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and predictive quality. We have renowned reference customers, competent technology, a good research team from renowned Universities, and the award of a renowned AI prize (e.g., EU Horizon 2020) which makes TVARIT one of the most innovative AI companies in Germany and Europe.

Requirements:

• Python Experience: Minimum 3+ years.
• Software Development Experience: Minimum 8+ years.
• Data Engineering and ETL Workloads: Minimum 2+ years.
• Familiarity with Software Development Life Cycle (SDLC).
• CI/CD Pipeline Development: Experience in developing CI/CD pipelines for large projects.
• Agile Framework & Sprint Methodology: Experience with Jira.
• Source Version Control: Experience with GitHub or similar SVC.
• Team Leadership: Experience leading a team of software developers/data scientists.

Good to Have:

• Experience with Golang.
• DevOps/Cloud Experience (preferably AWS).
• Experience with React and TypeScript.

Responsibilities:

• Mentor and train a team of data scientists and software developers.
• Lead and guide the team in best practices for software development and data engineering.
• Develop and implement CI/CD pipelines.
• Ensure adherence to Agile methodologies and participate in sprint planning and execution.
• Collaborate with the team to ensure the successful delivery of projects.
• Provide on-site support and training in Pune.

Skills and Attributes:

• Strong leadership and mentorship abilities.
• Excellent problem-solving skills.
• Effective communication and teamwork.
• Ability to work in a fast-paced environment.
• Passionate about technology and continuous learning.

Note: This is a part-time position paid on an hourly basis. The initial commitment is 4-8 hours per week, with potential fluctuations.

Join TVARIT and be a pivotal part of shaping the future of software development and data engineering.

Technical Skills:

• Ability to understand and translate business requirements into design.
• Proficient in AWS infrastructure components such as S3, IAM, VPC, EC2, and Redshift.
• Experience in creating ETL jobs using Python/PySpark.
• Proficiency in creating AWS Lambda functions for event-based jobs.
• Knowledge of automating ETL processes using AWS Step Functions.
• Competence in building data warehouses and loading data into them.

Responsibilities:

• Understand business requirements and translate them into design.
• Assess AWS infrastructure needs for development work.
• Develop ETL jobs using Python/PySpark to meet requirements.
• Implement AWS Lambda for event-based tasks.
• Automate ETL processes using AWS Step Functions.
• Build data warehouses and manage data loading.
• Engage with customers and stakeholders to articulate the benefits of proposed solutions and frameworks.

Responsibilities:

• Designing Hive/HCatalog data model includes creating table definitions, file formats, compression techniques for Structured & Semi-structured data processing

• Implementing Spark processing based ETL frameworks

• Implementing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

• Modifying the Informatica-Teradata & Unix based data pipeline

• Enhancing the Talend-Hive/Spark & Unix based data pipelines

• Develop and Deploy Scala/Python based Spark Jobs for ETL processing

• Strong SQL & DWH concepts.

Preferred Background:

• Function as integrator between business needs and technology solutions, helping to create technology solutions to meet clients’ business needs

• Lead project efforts in defining scope, planning, executing, and reporting to stakeholders on strategic initiatives

• Understanding of EDW system of business and creating High level design document and low level implementation document

• Understanding of Big Data Lake system of business and creating High level design document and low level implementation document

• Designing Big data pipeline for Data Ingestion, Storage, Processing & Consumption

Your key responsibilities

• Create and maintain optimal data pipeline architecture. Should have experience in building batch/real-time ETL Data Pipelines. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• The individual will be responsible for solution design, integration, data sourcing, transformation, database design and implementation of complex data warehousing solutions.
• Responsible for development, support, maintenance, and implementation of a complex project module
• Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
• Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
• Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
• Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support.
• complete reporting solutions.
• Preparation of HLD about architecture of the application and high level design.
• Preparation of LLD about job design, job description and in detail information of the jobs.
• Preparation of Unit Test cases and execution of the same.
• Provide technical guidance and mentoring to application development teams throughout all the phases of the software development life cycle

Skills and attributes for success

• Strong experience in SQL. Proficient in writing performant SQL working with large data volumes. Proficiency in writing and debugging complex SQLs.
• Strong experience in database system Microsoft Azure. Experienced in Azure Data Factory.
• Strong in Data Warehousing concepts. Experience with large-scale data warehousing architecture and data modelling.

• Should have enough experience to work on Power Shell Scripting

• Able to guide the team through the development, testing and implementation stages and review the completed work effectively
• Able to make quick decisions and solve technical problems to provide an efficient environment for project implementation
• Primary owner of delivery, timelines. Review code was written by other engineers.
• Maintain highest levels of development practices including technical design, solution development, systems configuration, test documentation/execution, issue identification and resolution, writing clean, modular and self-sustaining code, with repeatable quality and predictability
• Must have understanding of business intelligence development in the IT industry
• Outstanding written and verbal communication skills
• Should be adept in SDLC process - requirement analysis, time estimation, design, development, testing and maintenance
• Hands-on experience in installing, configuring, operating, and monitoring CI/CD pipeline tools
• Should be able to orchestrate and automate pipeline
• Good to have : Knowledge of distributed systems such as Hadoop, Hive, Spark

To qualify for the role, you must have

• Bachelor's Degree in Computer Science, Economics, Engineering, IT, Mathematics, or related field preferred
• More than 6 years of experience in ETL development projects
• Proven experience in delivering effective technical ETL strategies
• Microsoft Azure project experience
• Technologies: ETL- ADF, SQL, Azure components (must-have), Python (nice to have)

Ideally, you’ll also have

We are looking for a Senior Data Engineer to join the Customer Innovation team, who will be responsible for acquiring, transforming, and integrating customer data onto our Data Activation Platform from customers’ clinical, claims, and other data sources. You will work closely with customers to build data and analytics solutions to support their business needs, and be the engine that powers the partnership that we build with them by delivering high-fidelity data assets.

In this role, you will work closely with our Product Managers, Data Scientists, and Software Engineers to build the solution architecture that will support customer objectives. You'll work with some of the brightest minds in the industry, work with one of the richest healthcare data sets in the world, use cutting-edge technology, and see your efforts affect products and people on a regular basis. The ideal candidate is someone that

• Has healthcare experience and is passionate about helping heal people,
• Loves working with data,
• Has an obsessive focus on data quality,
• Is comfortable with ambiguity and making decisions based on available data and reasonable assumptions,
• Has strong data interrogation and analysis skills,
• Defaults to written communication and delivers clean documentation, and,
• Enjoys working with customers and problem solving for them.

A day in the life at Innovaccer:

• Define the end-to-end solution architecture for projects by mapping customers’ business and technical requirements against the suite of Innovaccer products and Solutions.
• Measure and communicate impact to our customers.
• Enabling customers on how to activate data themselves using SQL, BI tools, or APIs to solve questions they have at speed.

What You Need:

• 4+ years of experience in a Data Engineering role, a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
• 4+ years of experience working with relational databases like Snowflake, Redshift, or Postgres.
• Intermediate to advanced level SQL programming skills.
• Data Analytics and Visualization (using tools like PowerBI)
• The ability to engage with both the business and technical teams of a client - to document and explain technical problems or concepts in a clear and concise way.
• Ability to work in a fast-paced and agile environment.
• Easily adapt and learn new things whether it’s a new library, framework, process, or visual design concept.

What we offer:

• Industry certifications: We want you to be a subject matter expert in what you do. So, whether it’s our product or our domain, we’ll help you dive in and get certified.
• Quarterly rewards and recognition programs: We foster learning and encourage people to take risks. We recognize and reward your hard work.
• Health benefits: We cover health insurance for you and your loved ones.
• Sabbatical policy: We encourage people to take time off and rejuvenate, learn new skills, and pursue their interests so they can generate new ideas with Innovaccer.
• Pet-friendly office and open floor plan: No boring cubicles.

Company Profile:

Easebuzz is a payment solutions (fintech organisation) company which enables online merchants to accept, process and disburse payments through developer friendly APIs. We are focusing on building plug n play products including the payment infrastructure to solve complete business problems. Definitely a wonderful place where all the actions related to payments, lending, subscription, eKYC is happening at the same time.

We have been consistently profitable and are constantly developing new innovative products, as a result, we are able to grow 4x over the past year alone. We are well capitalised and have recently closed a fundraise of $4M in March, 2021 from prominent VC firms and angel investors. The company is based out of Pune and has a total strength of 180 employees. Easebuzz’s corporate culture is tied into the vision of building a workplace which breeds open communication and minimal bureaucracy. An equal opportunity employer, we welcome and encourage diversity in the workplace. One thing you can be sure of is that you will be surrounded by colleagues who are committed to helping each other grow.

Easebuzz Pvt. Ltd. has its presence in Pune, Bangalore, Gurugram.

Salary: As per company standards.

Designation: Data Engineering

Location: Pune

Experience with ETL, Data Modeling, and Data Architecture

Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties
- Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue.

Experience with AWS cloud data lake for development of real-time or near real-time use cases

Experience with messaging systems such as Kafka/Kinesis for real time data ingestion and processing

Build data pipeline frameworks to automate high-volume and real-time data delivery

Create prototypes and proof-of-concepts for iterative development.

Experience with NoSQL databases, such as DynamoDB, MongoDB etc

Create and maintain optimal data pipeline architecture,

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.

Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Evangelize a very high standard of quality, reliability and performance for data models and algorithms that can be streamlined into the engineering and sciences workflow

Build and enhance data pipeline architecture by designing and implementing data ingestion solutions.

Employment Type

Full-time

Key skills : Python, Numpy, Panda, SQL, ETL 

Roles and Responsibilities:

- The work will involve the development of workflows triggered by events from other systems

- Design, develop, test, and deliver software solutions in the FX Derivatives group

- Analyse requirements for the solutions they deliver, to ensure that they provide the right solution

- Develop easy to use documentation for the frameworks and tools developed for adaption by other teams

Familiarity with event-driven programming in Python

- Must have unit testing and debugging skills

- Good problem solving and analytical skills

- Python packages such as NumPy, Scikit learn

- Testing and debugging applications.

- Developing back-end components.

ABOUT US:
Pingahla was founded by a group of people passionate about making the world a better place by harnessing
the power of Data. We are a data management firm with offices in New York and India.Our mission is to help transform the way companies operate and think about their business. We make it easier
to adopt and stay ahead of the curve in the ever-changing digital landscape. One of our core beliefs is
excellence in everything we do!

JOB DESCRIPTION:
Pingahla is recruiting ETL & BI Test Manager who can build and lead a team, establish infrastructure, processes
and best practices for our Quality Assurance vertical. The candidates are expected to have at least 5+ years of experience with ETL Testing and working in Data Management project testing. Being a growing company, we will be able to provide very good career opportunities and a very attractive remuneration.

JOB ROLE & RESPONSIBILITIES:
• Plans and manages the testing activities;
• Defect Management and Weekly & Monthly Test report Generation;
• Work as a Test Manager to design Test Strategy and approach for DW&BI - (ETL & BI) solution;
• Provide leadership and directions to the team on quality standards and testing best practices;
• Ensured that project deliverables are produced, including, but not limited to: quality assurance plans,
test plans, testing priorities, status reports, user documentation, online help, etc. Managed and
motivated teams to accomplish significant deliverables within tight deadlines.
• Test Data Management; Reviews and approves all test cases prior to execution;
• Coordinates and reviews offshore work efforts for projects and maintenance activities.

REQUIRED SKILLSET:
• Experience in Quality Assurance Management, Program Management, DW - (ETL & BI)
Management
• Minimum 5 years in ETL Testing, at least 2 years in the Team Lead role
• Technical abilities complemented by sound communication skills, user interaction abilities,
requirement gathering and analysis, and skills in data migration and conversion strategies.
• Proficient in test definition, capable of developing test plans and test cases from technical
specifications
• Single handedly looking after complete delivery from testing side.
• Experience working with remote teams, across multiple time zones.
• Must have a strong knowledge of QA processes and methodologies
• Strong UNIX and PERL scripting skills
• Expertise with ETL testing & hands-on with working on ETL tool like Informatica, DataStage
PL/SQL is a plus.
• Excellent problem solving, analytical and technical troubleshooting skills.
• Familiar with Data Management projects.
• Eager to learn, adopt and apply rapidly changing new technologies and methodologies.
• Efficient and effective at approaching and escalating quality issues when appropriate.

We at Datametica Solutions Private Limited are looking for an SQL Lead / Architect who has a passion for the cloud with knowledge of different on-premises and cloud Data implementation in the field of Big Data and Analytics including and not limiting to Teradata, Netezza, Exadata, Oracle, Cloudera, Hortonworks and alike.

Ideal candidates should have technical experience in migrations and the ability to help customers get value from Datametica's tools and accelerators.

Job Description :

Experience: 6+ Years

Work Location: Pune / Hyderabad

Technical Skills :

• Good programming experience as an Oracle PL/SQL, MySQL, and SQL Server Developer
• Knowledge of database performance tuning techniques
• Rich experience in a database development
• Experience in Designing and Implementation Business Applications using the Oracle Relational Database Management System
• Experience in developing complex database objects like Stored Procedures, Functions, Packages and Triggers using SQL and PL/SQL
•  

Required Candidate Profile :

• Excellent communication, interpersonal, analytical skills and strong ability to drive teams
• Analyzes data requirements and data dictionary for moderate to complex projects • Leads data model related analysis discussions while collaborating with Application Development teams, Business Analysts, and Data Analysts during joint requirements analysis sessions
• Translate business requirements into technical specifications with an emphasis on highly available and scalable global solutions
• Stakeholder management and client engagement skills
• Strong communication skills (written and verbal)

About Us!

A global leader in the Data Warehouse Migration and Modernization to the Cloud, we empower businesses by migrating their Data/Workload/ETL/Analytics to the Cloud by leveraging Automation.

We have expertise in transforming legacy Teradata, Oracle, Hadoop, Netezza, Vertica, Greenplum along with ETLs like Informatica, Datastage, AbInitio & others, to cloud-based data warehousing with other capabilities in data engineering, advanced analytics solutions, data management, data lake and cloud optimization.

Datametica is a key partner of the major cloud service providers - Google, Microsoft, Amazon, Snowflake.

We have our own products!

Eagle Data warehouse Assessment & Migration Planning Product

Raven Automated Workload Conversion Product

Pelican Automated Data Validation Product, which helps automate and accelerate data migration to the cloud.

Why join us!

Datametica is a place to innovate, bring new ideas to live, and learn new things. We believe in building a culture of innovation, growth, and belonging. Our people and their dedication over these years are the key factors in achieving our success.

Benefits we Provide!

Working with Highly Technical and Passionate, mission-driven people

Subsidized Meals & Snacks

Flexible Schedule

Approachable leadership

Access to various learning tools and programs

Pet Friendly

Certification Reimbursement Policy

Check out more about us on our website below!

www.datametica.com

• Must have 4 to 7 years of experience in ETL Design and Development using Informatica Components.
• Should have extensive knowledge in Unix shell scripting.
• Understanding of DW principles (Fact, Dimension tables, Dimensional Modelling and Data warehousing concepts).
• Research, development, document and modification of ETL processes as per data architecture and modeling requirements.
• Ensure appropriate documentation for all new development and modifications of the ETL processes and jobs.
• Should be good in writing complex SQL queries.

• • Selected candidates will be provided training opportunities on one or more of following: Google Cloud, AWS, DevOps Tools, Big Data technologies like Hadoop, Pig, Hive, Spark, Sqoop, Flume and
• Kafka would get chance to be part of the enterprise-grade implementation of Cloud and Big Data systems
• Will play an active role in setting up the Modern data platform based on Cloud and Big Data
• Would be part of teams with rich experience in various aspects of distributed systems and computing.

We at Datametica Solutions Private Limited are looking for SQL Engineers who have a passion for cloud with knowledge of different on-premise and cloud Data implementation in the field of Big Data and Analytics including and not limiting to Teradata, Netezza, Exadata, Oracle, Cloudera, Hortonworks and alike. 

Ideal candidates should have technical experience in migrations and the ability to help customers get value from Datametica's tools and accelerators.

Job Description

Experience : 4-10 years

Location : Pune

Mandatory Skills - 

• Strong in ETL/SQL development
• Strong Data Warehousing skills
• Hands-on experience working with Unix/Linux
• Development experience in Enterprise Data warehouse projects
• Good to have experience working with Python, shell scripting
•  

Opportunities -

• Selected candidates will be provided training opportunities on one or more of the following: Google Cloud, AWS, DevOps Tools, Big Data technologies like Hadoop, Pig, Hive, Spark, Sqoop, Flume and Kafka
• Would get chance to be part of the enterprise-grade implementation of Cloud and Big Data systems
• Will play an active role in setting up the Modern data platform based on Cloud and Big Data
• Would be part of teams with rich experience in various aspects of distributed systems and computing

About Us!

A global Leader in the Data Warehouse Migration and Modernization to the Cloud, we empower businesses by migrating their Data/Workload/ETL/Analytics to the Cloud by leveraging Automation.

We have expertise in transforming legacy Teradata, Oracle, Hadoop, Netezza, Vertica, Greenplum along with ETLs like Informatica, Datastage, AbInitio & others, to cloud-based data warehousing with other capabilities in data engineering, advanced analytics solutions, data management, data lake and cloud optimization.

Datametica is a key partner of the major cloud service providers - Google, Microsoft, Amazon, Snowflake.

We have our own products!

Eagle – Data warehouse Assessment & Migration Planning Product

Raven – Automated Workload Conversion Product

Pelican - Automated Data Validation Product, which helps automate and accelerate data migration to the cloud.

Why join us!

Datametica is a place to innovate, bring new ideas to live and learn new things. We believe in building a culture of innovation, growth and belonging. Our people and their dedication over these years are the key factors in achieving our success.

Benefits we Provide!

Working with Highly Technical and Passionate, mission-driven people

Subsidized Meals & Snacks

Flexible Schedule

Approachable leadership

Access to various learning tools and programs

Pet Friendly

Certification Reimbursement Policy

Check out more about us on our website below!

http://www.datametica.com/">www.datametica.com

Datametica is Hiring for Datastage Developer

• Must have 3 to 8 years of experience in ETL Design and Development using IBM Datastage Components.
• Should have extensive knowledge in Unix shell scripting.
• Understanding of DW principles (Fact, Dimension tables, Dimensional Modelling and Data warehousing concepts).
• Research, development, document and modification of ETL processes as per data architecture and modeling requirements.
• Ensure appropriate documentation for all new development and modifications of the ETL processes and jobs.
• Should be good in writing complex SQL queries.

About Us!

A global Leader in the Data Warehouse Migration and Modernization to the Cloud, we empower businesses by migrating their Data/Workload/ETL/Analytics to the Cloud by leveraging Automation.

We have expertise in transforming legacy Teradata, Oracle, Hadoop, Netezza, Vertica, Greenplum along with ETLs like Informatica, Datastage, AbInitio & others, to cloud-based data warehousing with other capabilities in data engineering, advanced analytics solutions, data management, data lake and cloud optimization.

Datametica is a key partner of the major cloud service providers - Google, Microsoft, Amazon, Snowflake.

We have our own products!

Eagle – Data warehouse Assessment & Migration Planning Product

Raven – Automated Workload Conversion Product

Pelican - Automated Data Validation Product, which helps automate and accelerate data migration to the cloud.

Why join us!

Datametica is a place to innovate, bring new ideas to live and learn new things. We believe in building a culture of innovation, growth and belonging. Our people and their dedication over these years are the key factors in achieving our success.

Benefits we Provide!

Working with Highly Technical and Passionate, mission-driven people

Subsidized Meals & Snacks

Flexible Schedule

Approachable leadership

Access to various learning tools and programs

Pet Friendly

Certification Reimbursement Policy

Check out more about us on our website below!

www.datametica.com

Job Description

Experience : 10+ Years

Location : Pune

Job Requirements:

• Minimum of 10+ years of experience with a proven record of increased responsibility
• Hands on experience in design, development and managing Big Data, Cloud, Data warehousing
• and Business Intelligence projects
• Experience of managing projects in Big Data, Cloud, Data warehousing, Business Intelligence
• Using open source or top of the line tools and technologies
• Good knowledge of Dimensional Modeling
• Experience of working with any ETL and BI Reporting tools
• Experience of managing medium to large projects, preferably on Big Data
• Proven experience in project planning, estimation, execution and implementation of medium to
• large projects
• Should be able to effectively communicate in English
• Strong management and leadership skills, with proven ability to develop and manage client
• relationships
• Proven problem-solving skills from both technical and managerial perspectives
• Attention to detail and a commitment to excellence and high standards
• Excellent interpersonal and communication skills, both verbal and written
• Position is remote with occasional travel to other offices, client sites, conventions, training
• locations, etc.
• Bachelor’s degree in Computer Science, Business\Economics, or a related field or demonstrated,
• equivalent/practical knowledge or experience

Job Responsibilities:

• Day to day project management, scrum and agile management including project planning, delivery
• and execution of Big Data and
• Primary Point of contact for customer related to all project engagements, delivery and project
• escalations
• Design right architecture and technology stack depending on business requirement on Cloud / Big
• Data and BI related technologies both some on-premise and on cloud
• Liaise with key stakeholders to define the Cloud / Big data solutions roadmap, prioritize the
• deliverables
• Responsible for end to end project delivery of Cloud / Big Data Solutions from project estimations,
• project planning, resourcing and monitoring perspective
• Drive and participate in requirements gathering workshops, estimation discussions, design
• meetings and status review meetings
• Support & assist the team in resolving issues during testing and when the system is in production
• Involved in the full customer lifecycle with a goal to make customers successful and increase
• revenue and retention
• Interface with the offshore engineering team to solve customer issues
• Develop programs that meet customer needs with respect to functionality, performance,
• scalability, reliability, schedule, principles and recognized industry standards
• Requirement analysis and documentation
• Manage day-to-day operational aspects of a project and scope
• Prepare for engagement reviews and quality assurance procedures
• Visit and/or host clients to strengthen business relationships

• Expertise in designing and implementing enterprise scale database (OLTP) and Data warehouse solutions.
• Hands on experience in implementing Azure SQL Database, Azure SQL Date warehouse (Azure Synapse Analytics) and big data processing using Azure Databricks and Azure HD Insight.
• Expert in writing T-SQL programming for complex stored procedures, functions, views and query optimization.
• Should be aware of Database development for both on-premise and SAAS Applications using SQL Server and PostgreSQL.
• Experience in ETL and ELT implementations using Azure Data Factory V2 and SSIS.
• Experience and expertise in building machine learning models using Logistic and linear regression, Decision tree  and Random forest Algorithms.
• PolyBase queries for exporting and importing data into Azure Data Lake.
• Building data models both tabular and multidimensional using SQL Server data tools.
• Writing data preparation, cleaning and processing steps using Python, SCALA, and R.
• Programming experience using python libraries NumPy, Pandas and Matplotlib.
• Implementing NOSQL databases and writing queries using cypher.
• Designing end user visualizations using Power BI, QlikView and Tableau.
• Experience working with all versions of SQL Server 2005/2008/2008R2/2012/2014/2016/2017/2019
• Experience using the expression languages MDX and DAX.
• Experience in migrating on-premise SQL server database to Microsoft Azure.
• Hands on experience in using Azure blob storage, Azure Data Lake Storage Gen1 and Azure Data Lake Storage Gen2.
• Performance tuning complex SQL queries, hands on experience using SQL Extended events.
• Data modeling using Power BI for Adhoc reporting.
• Raw data load automation using T-SQL and SSIS
• Expert in migrating existing on-premise database to SQL Azure.
• Experience in using U-SQL for Azure Data Lake Analytics.
• Hands on experience in generating SSRS reports using MDX.
• Experience in designing predictive models using Python and SQL Server.
• Developing machine learning models using Azure Databricks and SQL Server

 Review all job requirements and specifications required for deploying the solution into the production environment. 

 Perform various unit/tests as per the checklist on deployment steps with help of test cases and maintain documents for the same. 

 Work with Lead to resolve all issues within the required timeframe and inform for any delays. 

 Collaborate with the development team to review new programs for implementation activities and manage communication (if required) with different functions to resolve issues and assist implementation leads to manage production deployments. 

 Document all issues during the deployment phase and document all findings from logs/during actual deployment and share the analysis. 

 Review and maintain all technical and business documents.  Conduct and monitor software implementation lifecycle and assist/make appropriate customization to all software for clients as per the deployment/implementation guide 

 Train new members on product deployment, issues and identify all issues in processes and provide solutions for the same. 

 Ensure project tasks as appropriately updated in JIRA / ticket tool for in-progress/done and raise the issues. 

 Should take self-initiative to learn/understand the technologies i.e. Vertica SQL, Internal Data integration tool (Athena), Pulse Framework, Tableau. 

 Flexible to work during non-business hours in some exceptional cases (for a few days) required to meet the client time zones. 

Experience on Tools and Technologies preferred: 

ETL Tools: Talend or Informatica ,Abinitio,Datastage 

BI Tools: Tableau or Jaspersoft or Pentaho or Qlikview experience 

Database: Experience in Oracle or SS 

Methodology: Experience in SDLC and/or Agile Methodology

We are looking for a Senior Database Developer to provide a senior-level contribution to design, develop and implement critical business enterprise applications for marketing systems 

1. Play a lead role in developing, deploying and managing our databases (Oracle, My SQL and Mongo) on Public Clouds.
2. Design and develop PL/SQL processes to perform complex ETL processes. 
3. Develop UNIX and Perl scripts for data auditing and automation. 
4. Responsible for database builds and change requests.
5. Holistically define the overall reference architecture and manage its overall implementation in the production systems.
6. Identify architecture gaps that can improve availability, performance and security for both productions systems and database systems and works towards resolving those issues.
7. Work closely with Engineering, Architecture, Business and Operations teams to provide necessary and continuous feedback.

1. Automate all the manual steps for the database platform.
2. Deliver solutions for access management, availability, security, replication and patching.
3. Troubleshoot application database performance issues.
4. Participate in daily huddles (30 min.) to collaborate with onshore and offshore teams.

Qualifications: 

1. 5+ years of experience in database development.
2. Bachelor’s degree in Computer Science, Computer Engineering, Math, or similar.
3. Experience using ETL tools (Talend or Ab Initio a plus).
4. Experience with relational database programming, processing and tuning (Oracle, PL/SQL, My SQL, MS SQL Server, SQL, TSQL).
5. Familiarity with BI tools (Cognos, Tableau, etc.).
6. Experience with Cloud technology (AWS, etc.).
7. Agile or Waterfall methodology experience preferred.
8. Experience with API integration.
9. Advanced software development and scripting skills for use in automation and interfacing with databases.
10. Knowledge of software development lifecycles and methodologies.
11. Knowledge of developing procedures, packages and functions in a DW environment.
12. Knowledge of UNIX, Linux and Service Oriented Architecture (SOA).
13. Ability to multi-task, to work under pressure, and think analytically.
14. Ability to work with minimal supervision and meet deadlines.
15. Ability to write technical specifications and documents.
16. Ability to communicate effectively with individuals at all levels in the company and with various business contacts outside of the company in an articulate, professional manner.
17. Knowledge of CDP, CRM, MDM and Business Intelligence is a plus.
18. Flexible work hours.

This position description is intended to describe the duties most frequently performed by an individual in this position. It is not intended to be a complete list of assigned duties but to describe a position level.