11+ ETL management Jobs in Pune | ETL management Job openings in Pune

Your key responsibilities

• Create and maintain optimal data pipeline architecture. Should have experience in building batch/real-time ETL Data Pipelines. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• The individual will be responsible for solution design, integration, data sourcing, transformation, database design and implementation of complex data warehousing solutions.
• Responsible for development, support, maintenance, and implementation of a complex project module
• Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
• Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
• Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
• Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support.
• complete reporting solutions.
• Preparation of HLD about architecture of the application and high level design.
• Preparation of LLD about job design, job description and in detail information of the jobs.
• Preparation of Unit Test cases and execution of the same.
• Provide technical guidance and mentoring to application development teams throughout all the phases of the software development life cycle

Skills and attributes for success

• Strong experience in SQL. Proficient in writing performant SQL working with large data volumes. Proficiency in writing and debugging complex SQLs.
• Strong experience in database system Microsoft Azure. Experienced in Azure Data Factory.
• Strong in Data Warehousing concepts. Experience with large-scale data warehousing architecture and data modelling.

• Should have enough experience to work on Power Shell Scripting

• Able to guide the team through the development, testing and implementation stages and review the completed work effectively
• Able to make quick decisions and solve technical problems to provide an efficient environment for project implementation
• Primary owner of delivery, timelines. Review code was written by other engineers.
• Maintain highest levels of development practices including technical design, solution development, systems configuration, test documentation/execution, issue identification and resolution, writing clean, modular and self-sustaining code, with repeatable quality and predictability
• Must have understanding of business intelligence development in the IT industry
• Outstanding written and verbal communication skills
• Should be adept in SDLC process - requirement analysis, time estimation, design, development, testing and maintenance
• Hands-on experience in installing, configuring, operating, and monitoring CI/CD pipeline tools
• Should be able to orchestrate and automate pipeline
• Good to have : Knowledge of distributed systems such as Hadoop, Hive, Spark

To qualify for the role, you must have

• Bachelor's Degree in Computer Science, Economics, Engineering, IT, Mathematics, or related field preferred
• More than 6 years of experience in ETL development projects
• Proven experience in delivering effective technical ETL strategies
• Microsoft Azure project experience
• Technologies: ETL- ADF, SQL, Azure components (must-have), Python (nice to have)

Ideally, you’ll also have

Greetings , Wissen Technology is Hiring for the position of Data Engineer

Please find the Job Description for your Reference:

JD

• Design, develop, and maintain data pipelines on AWS EMR (Elastic MapReduce) to support data processing and analytics.
• Implement data ingestion processes from various sources including APIs, databases, and flat files.
• Optimize and tune big data workflows for performance and scalability.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Manage and monitor EMR clusters, ensuring high availability and reliability.
• Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and store data in data lakes and data warehouses.
• Implement data security best practices to ensure data is protected and compliant with relevant regulations.
• Create and maintain technical documentation related to data pipelines, workflows, and infrastructure.
• Troubleshoot and resolve issues related to data processing and EMR cluster performance.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• 5+ years of experience in data engineering, with a focus on big data technologies.
• Strong experience with AWS services, particularly EMR, S3, Redshift, Lambda, and Glue.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with big data frameworks and tools such as Hadoop, Spark, Hive, and Pig.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Experience with SQL and NoSQL databases.
• Familiarity with CI/CD pipelines and version control systems (e.g., Git).
• Strong problem-solving skills and the ability to work independently and collaboratively in a team environment

The ideal candidate is a motivated, organized, and creative individual who welcomes the challenges of acquiring and developing new business through sales efforts. You will build key customer relationships, identify business opportunities, and close business deals while maintaining extensive knowledge of current market conditions.

Responsibilities
Act as the initial point of contact for all client related concerns ,which indeed makes you the main communication channel between the clients and the developers.

• Cultivate strong business relationships with key decision-makers

• Proactively identify new opportunities and deliver innovative solutions to customers

• Develop market strategies by researching lists of high potential prospects Qualifications

• Bachelor's degree or equivalent experience in Business from a top University/College

• 0-1 year of sales or account management experience

• Excellent written and verbal communication skills

• 1-9 years of overall working experience in the software environment.
• Minimum 3 years of experience in Agile Software Development.
• NET technologies - .NET 5, .NET Core, C#, Web API, Angular, Typescript, Azure and MS SQL.
• Coding and designing skills.
• Knowledge of database, SQL Queries, procedures & functions is must.
• Good knowledge of cloud concepts and CI/CD.
• Ability to assimilate technical and functional solutions.
• Ability to do code review and deliver quality.
• Knowledge of unit testing with mock.
• Cloud experience.
• Experience using TFS/GIT source control.
• Containerization (Docker) plus orchestration (Kubernetes or OpenShift) are good to have.
• Good written and spoken English.
• Excellent service & industry leading solutions development.

ABOUT US:
Pingahla was founded by a group of people passionate about making the world a better place by harnessing
the power of Data. We are a data management firm with offices in New York and India.Our mission is to help transform the way companies operate and think about their business. We make it easier
to adopt and stay ahead of the curve in the ever-changing digital landscape. One of our core beliefs is
excellence in everything we do!

JOB DESCRIPTION:
Pingahla is recruiting ETL & BI Test Manager who can build and lead a team, establish infrastructure, processes
and best practices for our Quality Assurance vertical. The candidates are expected to have at least 5+ years of experience with ETL Testing and working in Data Management project testing. Being a growing company, we will be able to provide very good career opportunities and a very attractive remuneration.

JOB ROLE & RESPONSIBILITIES:
• Plans and manages the testing activities;
• Defect Management and Weekly & Monthly Test report Generation;
• Work as a Test Manager to design Test Strategy and approach for DW&BI - (ETL & BI) solution;
• Provide leadership and directions to the team on quality standards and testing best practices;
• Ensured that project deliverables are produced, including, but not limited to: quality assurance plans,
test plans, testing priorities, status reports, user documentation, online help, etc. Managed and
motivated teams to accomplish significant deliverables within tight deadlines.
• Test Data Management; Reviews and approves all test cases prior to execution;
• Coordinates and reviews offshore work efforts for projects and maintenance activities.

REQUIRED SKILLSET:
• Experience in Quality Assurance Management, Program Management, DW - (ETL & BI)
Management
• Minimum 5 years in ETL Testing, at least 2 years in the Team Lead role
• Technical abilities complemented by sound communication skills, user interaction abilities,
requirement gathering and analysis, and skills in data migration and conversion strategies.
• Proficient in test definition, capable of developing test plans and test cases from technical
specifications
• Single handedly looking after complete delivery from testing side.
• Experience working with remote teams, across multiple time zones.
• Must have a strong knowledge of QA processes and methodologies
• Strong UNIX and PERL scripting skills
• Expertise with ETL testing & hands-on with working on ETL tool like Informatica, DataStage
PL/SQL is a plus.
• Excellent problem solving, analytical and technical troubleshooting skills.
• Familiar with Data Management projects.
• Eager to learn, adopt and apply rapidly changing new technologies and methodologies.
• Efficient and effective at approaching and escalating quality issues when appropriate.