Cutshort logo
DataToBiz Pvt. Ltd. logo
ETL Engineer - Data Pipeline
ETL Engineer - Data Pipeline
DataToBiz Pvt. Ltd.'s logo

ETL Engineer - Data Pipeline

PS Dhillon's profile picture
Posted by PS Dhillon
2 - 6 yrs
₹7L - ₹15L / yr
Chandigarh, Delhi, Gurugram, Noida
Skills
ETL
skill iconAmazon Web Services (AWS)
Amazon Redshift
skill iconPython
Job Responsibilities : - Developing new data pipelines and ETL jobs for processing millions of records and it should be scalable with growth.
Pipelines should be optimised to handle both real time data, batch update data and historical data.
Establish scalable, efficient, automated processes for complex, large scale data analysis.
Write high quality code to gather and manage large data sets (both real time and batch data) from multiple sources, perform ETL and store it in a data warehouse.
Manipulate and analyse complex, high-volume, high-dimensional data from varying sources using a variety of tools and data analysis techniques.
Participate in data pipelines health monitoring and performance optimisations as well as quality documentation.
Interact with end users/clients and translate business language into technical requirements.
Acts independently to expose and resolve problems.

Job Requirements :-
2+ years experience working in software development & data pipeline development for enterprise analytics.
2+ years of working with Python with exposure to various warehousing tools
In-depth working with any of commercial tools like AWS Glue, Ta-lend, Informatica, Data-stage, etc.
Experience with various relational databases like MySQL, MSSql, Oracle etc. is a must.
Experience with analytics and reporting tools (Tableau, Power BI, SSRS, SSAS).
Experience in various DevOps practices helping the client to deploy and scale the systems as per requirement.
Strong verbal and written communication skills with other developers and business client.
Knowledge of Logistics and/or Transportation Domain is a plus.
Hands-on with traditional databases and ERP systems like Sybase and People-soft.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About DataToBiz Pvt. Ltd.

Founded :
2017
Type :
Services
Size :
20-100
Stage :
Bootstrapped

About

With vision comes the insight and with insight comes the faith. We deliver the precise information/insights for your eye to visualize the facts and take the required decision with faith when it comes to making a business move. Everything now is based on assurity, the assurity that one gets from the information that is driven via collected raw data. We at DataToBiz help frame and explore that raw data to bring forth the facts behind it. These facts can help you fuel your business to rise above all others.

Read more

Connect with the team

Profile picture
Ankush Sharma
Profile picture
PS Dhillon

Company social profiles

bloglinkedintwitter

Similar jobs

NeoGenCode Technologies Pvt Ltd
Ritika Verma
Posted by Ritika Verma
Pune, Noida, Gurugram
5 - 8 yrs
₹13L - ₹17L / yr
ETL Tester
Azure Data factory
Azure SQL database
Azure ecosystem
SQL

Job Title: Sr. ETL Test Engineer

Experience: 7+ Years

Location: Gurgaon / Noida / Pune (Work From Office)

Joining: Immediate joiners only (≤15 days notice)

About the Role

We are seeking an experienced ETL Test Engineer with strong expertise in cloud-based ETL tools, Azure ecosystem, and advanced SQL skills. The ideal candidate will have a proven track record in validating complex data pipelines, ensuring data integrity, and collaborating with cross-functional teams in an Agile environment.

Key Responsibilities

  • Design, develop, and execute ETL test plans, test cases, and test scripts for cloud-based data pipelines.
  • Perform data validation, transformation, and reconciliation between source and target systems.
  • Work extensively with Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, and related Azure services.
  • Develop and run complex SQL queries for data extraction, analysis, and validation.
  • Collaborate with developers, business analysts, and product owners to clarify requirements and ensure comprehensive test coverage.
  • Perform regression, functional, and performance testing of ETL processes.
  • Identify defects, log them, and work with development teams to ensure timely resolution.
  • Participate in Agile ceremonies (daily stand-ups, sprint planning, retrospectives) and contribute to continuous improvement.
  • Ensure adherence to data quality and compliance standards.

Required Skills & Experience

  • 5+ years of experience in ETL testing, preferably with cloud-based ETL tools.
  • Strong hands-on experience with Azure Data Factory, Azure Synapse Analytics, and Azure SQL.
  • Advanced SQL query writing and performance tuning skills.
  • Strong understanding of data warehousing concepts, data models, and data governance.
  • Experience with Agile methodologies and working in a Scrum team.
  • Excellent communication and stakeholder management skills.
  • Strong problem-solving skills and attention to detail.

Preferred Skills

  • Experience with Python, PySpark, or automation frameworks for ETL testing.
  • Exposure to CI/CD pipelines in Azure DevOps or similar tools.
  • Knowledge of data security, compliance, and privacy regulations.


Read more
At a Venture-backed Series A Funded Startup
At a Venture-backed Series A Funded Startup
Agency job
via Qrata by Prajakta Kulkarni
Remote only
3 - 7 yrs
₹25L - ₹40L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
skill iconExpress
skill iconLeadership

Company Overview-

A venture-backed funded startup valued at 30.5 Million Dollars.

The team co-founders are both IIT-IIM Alumni with a strong professional background and are backed by some of the leading global and Indian funds and entrepreneurs.

Role Overview 

As a  Backend Engineer, you will be working closely with our core team in building products from scratch into large-scale platforms and solving business problems leveraging new and innovative technology. More than anything, we are looking for engineers that are eager to learn and build a meaningful company. We are a small team and encourage engineers to wear many hats

Responsibilities 

- Design and build highly reliable and performant applications that deliver a great user experience. 

- Own large technical deliverables and execute in a structured manner. - Take accountability for the overall health of the applications you build. - Platform components as libraries, utilities and promote reuse. 

- Be able to conceptualize and develop prototypes quickly 

Skills & Requirements 

▪ Work Experience between 1-3 years in large scale applications with the desire to work in fast-paced startups 

▪ Experience/Knowledge of Node.JS, Express.JS, AWS, MongoDB. 

Deep understanding of your tools: Languages, frameworks, systems.
Read more
SaaS Labs
at SaaS Labs
3 recruiters
Neha Bhaidkar
Posted by Neha Bhaidkar
remote
1 - 5 yrs
₹8L - ₹10L / yr
skill iconPHP
skill iconVue.js
skill iconBootstrap
MySQL
skill iconMongoDB
+3 more
  • 1-5 years of experience in a full stack software development role.
  • Experience in technologies - PHP, Bootstrap, Vuejs and MySQL.
  • Knowledge of Cloud services (GCP/AWS), MongoDB and Nodejs is a plus.
  • Experience of working in an Agile environment
  • Ability to design for scale and performance
  • Ability to do peer code reviews
  • Solid problem-solving skills
Read more
Salt Web Technologies Pvt Ltd
Sujay Bhagwat
Posted by Sujay Bhagwat
Pune
1 - 2 yrs
₹4.5L - ₹5L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconMongoDB

Job brief

We are looking for a Full Stack Developer to produce scalable software solutions. You’ll be part of a cross-functional team that’s responsible for the full software development life cycle, from conception to deployment.

As a Full Stack Developer, you should be comfortable around both front-end and back-end coding languages, development frameworks, and third-party libraries. You should also be a team player with a knack for visual design and utility.

If you’re also familiar with Agile methodologies, we’d like to meet you.

Responsibilities

  • Work with development teams and product managers to ideate software solutions
  • Design client-side and server-side architecture
  • Build the front-end of applications through appealing visual design
  • Develop and manage well-functioning databases and applications
  • Write effective APIs
  • Test software to ensure responsiveness and efficiency
  • Troubleshoot, debug and upgrade software
  • Create security and data protection settings
  • Build features and applications with a mobile responsive design
  • Write technical documentation
  • Work with data scientists and analysts to improve software

Requirements and skills

  • Proven experience as a Full Stack Developer or similar role
  • Experience developing desktop and mobile applications
  • Familiarity with common stacks
  • Knowledge of multiple front-end languages and libraries (e.g. HTML/ CSS, JavaScript, XML, jQuery)
  • Knowledge of multiple back-end languages (e.g. C#, Java, Python) and JavaScript frameworks (e.g. Angular, React, Node.js)
  • Familiarity with databases (e.g. MySQL, MongoDB), web servers (e.g. Apache), and UI/UX design
  • Excellent communication and teamwork skills
  • Great attention to detail
  • Organizational skills
  • An analytical mind
  • Degree in Computer Science, Statistics, or relevant field
Read more
CMML5  IT MNC from USA
CMML5 IT MNC from USA
Agency job
via Zeal Consultants by Zeal Consultants
Remote, Bengaluru (Bangalore), NCR (Delhi | Gurgaon | Noida)
5 - 15 yrs
₹18L - ₹33L / yr
DevOps
skill iconKubernetes
skill iconDocker
Ansible
Google Cloud Platform (GCP)
+1 more
Tech Lead : Infrastructure DevOps with Azure / GCP experience (Cloud Engineering)

We are hiring for a Lead DevOps Engineer in Cloud domain with hands on experience in Azure / GCP.

- Expertise in managing Cloud / VMWare resources and good exposure on Dockers/Kubernetes

- Working knowledge of operating systems( Unix, Linux, IBM AIX)

- Experience in installation, configuration and managing apache webserver, Tomcat/Jboss

- Good understanding of JVM, troubleshooting and performance tuning through thread dump and log analysis

-Strong expertise in Dev Ops tools:

- Deployment (Chef/Puppet/Ansible /Nebula/Nolio)

- SCM (TFS, GIT, ClearCase)

- Build tools (Ant,Maven, Make, Gradle)

- Artifact repositories (Nexes, JFrog ArtiFactory)

- CI tools (Jenkins, TeamCity),

- Experienced in scripting languages: Python, Ant, Bash and Shell

What will be required of you?

- Responsible for implementation and support of application/web server infrastructure for complex business applications

- Server configuration management, release management, deployments, automation & troubleshooting

- Set-up and configure Development, Staging, UAT and Production server environment for projects and install/configure all dependencies using the industry best practices

- Manage Code Repositories

- Manage, Document, Control and Innovate Development and Release procedure.

- Configure automated deployment on multiple environment

- Hands-on working experience of Azure or GCP.

- Knowledge Transfer the implementation to support team and until such time support any production issues
Read more
codersbrain
at codersbrain
1 recruiter
Aishwarya Hire
Posted by Aishwarya Hire
Remote, Kolkata, Mumbai
4 - 6 yrs
₹6L - ₹10L / yr
skill icon.NET
ASP.NET
skill iconC#
  • Analyze system requirements and prioritize tasks
  • Write clean, testable code using .NET programming languages
  • Develop technical specifications and architecture
  • Test and debug various .NET applications
  • Review and refactor code
  • Deploy fully functional applications
  • Upgrade existing programs
  • Support junior developers' work
  • Document development and operational procedures
Read more
M8 IT Solutions
at M8 IT Solutions
2 candid answers
Janani S
Posted by Janani S
Madurai
1 - 2 yrs
₹2L - ₹4L / yr
skill iconFlutter
User Interface (UI) Design
API

1) UI Design skill

2) Publishing Knowledge about the app store/ Play Store

3) Google map integration

4) Payment gateway integration

5) Firebase integration (push notification and crash report)

6) API Integration in Restfull API

7) Individual project handling (added advantage)

Read more
Bengaluru (Bangalore)
1 - 3 yrs
₹3L - ₹4L / yr
User Interface (UI) Design
UI Designer
Ownership Mentality
Job Brief:
We are looking for a talented UI Designer to create amazing user experiences.  The ideal candidate should have an eye for clean and artful design, and should possess good UI skills.

Responsibilities:
  • Collaborate with Product Management and Engineering to define and implement user-friendly UI solutions
  • Conceptualize original ideas that bring simplicity and user friendliness to complex design roadblocks
Read more
ownpath, Inc
at ownpath, Inc
1 recruiter
Shreyas Satish
Posted by Shreyas Satish
Remote only
4 - 12 yrs
₹12L - ₹18L / yr
Product design
Mentorship
User Experience (UX) Design

https://ownpath.xyz/">ownpath is an early stage startup with a mission of making ambitious career opportunities accessible to everyone, starting with Design. We recently completed a 3 month program on Design Management for Gojek, for which we received highly positive reviews. We had Kristin Skinner (Co-author of Org Design for Design Orgs) and Meredith Black (Ex-Pinterest) as some of the instructors for the program.

We're currently working on a https://ownpath.xyz/product-design-fellowship">Product Design Fellowship program to help junior designers develop key skills and transition towards becoming Product Designers at leading startups.

The program will involve designers working in teams, building live projects, and showcasing their work to prospective employers during Demo Day. We currently have Gojek, Razorpay, and Scripbox as industry partners. We're seeking a Head of Design Education to join us as part of the Founding team to help us run a successful cohort and build a foundation for future programs.

Key responsibilities

  • Own the program experience in terms of identifying focus areas, pedagogy, learning outcomes, and evaluation criterion, and ensuring a high placement rate
  • Collaborate closely with our instructional designer to innovate on scalable &highly engaging learning experiences
  • Conduct regular Office Hours to guide learners on their projects and curate learning resources for both the cohort and the broader design community
  • Collaborate with our community manager to grow our learner and mentor communities


You ideally have

  • Around 6 years worth of experience in designing digital products/experiences, preferably with some experience at fast-growing startups
  • Strong interest in making design education accessible and outcome-driven
  • Experience with conducting or organising conference talks or workshops
  • Excellent communication skills


Key Benefits

  • Huge opportunity for impact by helping build a design school from scratch as an exciting alternative to conventional avenues for higher education
  • Excellent stepping stone for a Head of Design role at fast-growing startups
  • Develop your network by interfacing with Heads of Design/Product in the industry
  • Get mentorship from Heads of Designs/Product


This is a full-time paid role, with an option to convert to a equity-based partner role based on performance and fit.

Shreyas Satish,

Founder & CEO,

ownpath, Inc.

Read more
Cliffjumpter Technology Pvt Ltd
Lokendra Surya
Posted by Lokendra Surya
NCR (Delhi | Gurgaon | Noida)
1 - 5 yrs
₹5L - ₹12L / yr
skill iconJavascript
skill iconPHP
skill iconPython
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)
+2 more
- Designed scalable Applications - Hands-on experience building end to end systems - Good architectural & design skills - Experiment and evaluate technologies through PoC's and study. - Strong coding, data structures, and algorithms - The ability to own end to end responsibility - right from a requirement to release - The ability to produce bug-free and production-grade code. Primary skills : JavaScript, HTML, CSS, Node.js, Express.JS, Bootstrap, MYSQL, Angular 1.x.js Good to have skills : - React.JS, D3.Js, Python, MongoDB, Redis, Kafka, Ansible, AWS, gulp, sass, less, microservices, Linux, PHP Key Deliverable's : - Design and develop end to end applications with very high quality - Develop a deep understanding of the startup ecosystem - Work with a performance oriented team driven by ownership and open to experiments
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos