Cutshort logo
Digital Technology solution logo
Data Engineer Azure Data Factory
Digital Technology solution
Data Engineer Azure Data Factory
Ad Astra Consultants's logo

Data Engineer Azure Data Factory

at Digital Technology solution

Agency job
5 - 7 yrs
₹12L - ₹17L / yr
Bengaluru (Bangalore)
Skills
Data Engineer
Hadoop
Spark
Kafka
Big Data
Data engineering
Data Factory
Azure
  • Create and maintain optimal data pipeline architecture,
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Author data services using a variety of programming languages
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure ‘big data’ technologies.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keep our data separated and secure across national boundaries through multiple data centers and Azure regions.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Work in an Agile environment with Scrum teams.
  • Ensure data quality and help in achieving data governance.

 

Basic Qualifications

 

  • 2+ years of experience in a Data Engineer role
  • Undergraduate degree required (Graduate degree preferred) in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
  • Experience using the following software/tools:
    • Experience with big data tools: Hadoop, Spark, Kafka, etc.
    • Experience with relational SQL and NoSQL databases
    • Experience with data pipeline and workflow management tools
    • Experience with Azure cloud services: ADLS, ADF, ADLA, AAS
    • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
    • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Pulsedata Labs Pvt Ltd
Pulsedata Labs Pvt Ltd
Agency job
Remote only
5 - 7 yrs
₹20L - ₹30L / yr
databricks
Spark
pythonspark
SQL server
ETL
+2 more

Company name: PulseData labs Pvt Ltd (captive Unit for URUS, USA)


About URUS

We are the URUS family (US), a global leader in products and services for Agritech.


SENIOR DATA ENGINEER

This role is responsible for the design, development, and maintenance of data integration and reporting solutions. The ideal candidate will possess expertise in Databricks and strong skills in SQL Server, SSIS and SSRS, and experience with other modern data engineering tools such as Azure Data Factory. This position requires a proactive and results-oriented individual with a passion for data and a strong understanding of data warehousing principles.


Responsibilities

Data Integration

  • Design, develop, and maintain robust and efficient ETL pipelines and processes on Databricks.
  • Troubleshoot and resolve Databricks pipeline errors and performance issues.
  • Maintain legacy SSIS packages for ETL processes.
  • Troubleshoot and resolve SSIS package errors and performance issues.
  • Optimize data flow performance and minimize data latency.
  • Implement data quality checks and validations within ETL processes.

Databricks Development

  • Develop and maintain Databricks pipelines and datasets using Python, Spark and SQL.
  • Migrate legacy SSIS packages to Databricks pipelines.
  • Optimize Databricks jobs for performance and cost-effectiveness.
  • Integrate Databricks with other data sources and systems.
  • Participate in the design and implementation of data lake architectures.

Data Warehousing

  • Participate in the design and implementation of data warehousing solutions.
  • Support data quality initiatives and implement data cleansing procedures.

Reporting and Analytics

  • Collaborate with business users to understand data requirements for department driven reporting needs.
  • Maintain existing library of complex SSRS reports, dashboards, and visualizations.
  • Troubleshoot and resolve SSRS report issues, including performance bottlenecks and data inconsistencies.

Collaboration and Communication

  • Comfortable in entrepreneurial, self-starting, and fast-paced environment, working both independently and with our highly skilled teams.
  • Collaborate effectively with business users, data analysts, and other IT teams.
  • Communicate technical information clearly and concisely, both verbally and in writing.
  • Document all development work and procedures thoroughly.

Continuous Growth

  • Keep abreast of the latest advancements in data integration, reporting, and data engineering technologies.
  • Continuously improve skills and knowledge through training and self-learning.

This job description reflects managements assignment of essential functions; it does not prescribe or restrict the tasks that may be assigned.


Requirements

  • Bachelor's degree in computer science, Information Systems, or a related field.
  • 7+ years of experience in data integration and reporting.
  • Extensive experience with Databricks, including Python, Spark, and Delta Lake.
  • Strong proficiency in SQL Server, including T-SQL, stored procedures, and functions.
  • Experience with SSIS (SQL Server Integration Services) development and maintenance.
  • Experience with SSRS (SQL Server Reporting Services) report design and development.
  • Experience with data warehousing concepts and best practices.
  • Experience with Microsoft Azure cloud platform and Microsoft Fabric desirable.
  • Strong analytical and problem-solving skills.
  • Excellent communication and interpersonal skills.
  • Ability to work independently and as part of a team.
  • Experience with Agile methodologies.



Read more
Wokelo AI
Ishvika Dwivedi
Posted by Ishvika Dwivedi
Remote only
1 - 3 yrs
₹6L - ₹7L / yr
SaaS
JIRA
Systems Development Life Cycle (SDLC)
Software Testing (QA)
Regression Testing
+3 more

We are looking for a detail-oriented SDET-1/Manual QA Engineer to join our QA team. You will be responsible for ensuring our software meets the highest standards of quality before reaching customers. This role involves carefully reviewing requirements and test plans, executing manual tests, and collaborating with product managers, developers to identify and resolve issues.


About Wokelo:


Wokelo is a Gen-AI powered investment research platform. It automates complex research and analysis tasks, traditionally performed by humans. Wokelo is leveraged by leading Private Equity, Investment Banks, Corporate Strategy, Venture capital, and Fortune 500 firms.


Our proprietary agentic technology and state-of-the-art large language models (LLMs) deliver rich insights and high-fidelity analysis in a matter of minutes, transforming how financial decisions are made.


We are headquartered in Seattle with a global team, supported by renowned venture funds and industry leaders who share our vision. We are growing fast and expanding across multiple segments.


Key Responsibilities:


  • Review user stories and requirements for clarity, completeness, and testability.
  • Execute test cases for new features, bug fixes, and regression cycles.
  • Perform exploratory, usability, smoke, and sanity testing across different environments.
  • Perform add hoc data quality checks and regular monitoring
  • Log defects with detailed reproduction steps, screenshots, and impact assessment.
  • Collaborate with developers and product managers during defect triage to ensure timely fixes.
  • Support release testing and assist with UAT (User Acceptance Testing).
  • Maintain organized test documentation and ensure traceability.
  • Perform add hoc data quality checks and regular monitoring tasks.


Skills & Qualifications:


  • 1–3 years of manual QA or software testing experience in SaaS/Product companies.
  • Familiarity with QA processes, SDLC, and defect life cycle.
  • Exposure to test management or bug tracking tools (e.g., JIRA, TestRail, Zephyr).
  • Ability to identify gaps in test coverage and propose improvements.
  • Strong attention to detail.


What We Offer?


  • Be part of a fast-growing startup shaping the future of AI-powered insights.
  • Work with a passionate, collaborative, and high-performance team.
  • Opportunity to work at the frontier of GenAI, data, and product strategy.
  • Full health coverage, flexible time-off, and remote work culture.
Read more
Codebuddy Pvt. Ltd.
at Codebuddy Pvt. Ltd.
2 recruiters
Abhishek Gupta
Posted by Abhishek Gupta
Kolkata, Pune
1 - 5 yrs
₹4L - ₹8L / yr
skill iconReact.js
skill iconReact Native
skill iconKotlin
skill iconSwift
Mobile App Development

Exciting Opportunity for React Native Developers!


🚀 Are you a passionate problem-solver who loves creating top-notch applications? Look no further! At Codebuddy, we're opening doors for talented React Native Developers like you!


What We Offer:


🌟 Challenging projects that push your skills to the limit!

🚀 Collaborative environment where innovation thrives!

💼 Competitive pay reflecting your hard work and dedication!

📚 Opportunities for continuous learning and career growth!

👥 A team that values your creativity and expertise!


What You'll Do:


🛠 Develop JavaScript applications using React.js or React Native.

🤝 Collaborate cross-functionally, working on diverse infrastructures.

🎨 Create seamless UI/UX with HTML, CSS, and JS, integrating the backend through REST API.

🖋 Write, execute, and maintain clean, reusable, scalable code.

🔧 Tackle bottlenecks, bugs, and ensure app responsiveness and performance.

💻 Work with React, Redux, Node.js, and contribute to code automation.


What We Look For:


💡 Strong JavaScript, React, API knowledge.

🏗 Familiarity with Object-Oriented Programming.

📝 GIT proficiency and ability to document code.

🔒 Attention to detail, analytical mindset, and proactive approach.

🚀 Passion for building industry-leading applications.


Join Us and Enjoy:


💰 Fair compensation for your exceptional efforts!

🤝 A supportive team environment where your ideas matter!

📈 Ongoing opportunities for professional development!

🌐 A chance to shape the future of innovative applications!

🏆 Recognition for your achievements and dedication!


If you're ready to take your skills to new heights and be part of a dynamic team, we want you! Apply now at Codebuddy and embark on an exciting journey of creativity and growth. Don't miss out on this incredible opportunity! 🚀

Read more
For startup logistic company
For startup logistic company
Agency job
via zyoin by Shubha N
Bengaluru (Bangalore)
3 - 10 yrs
₹40L - ₹65L / yr
Product Management
product manager
payments
Payment gateways
Payment systems

Position

The role is responsible for building a vertical payments experience across all the payments for a Vehicle. All users are from cities in tier 2/3/4 who are mobile-first and have close to no exposure to digital payments

BlackBuck will be building a network of merchants across multiple categories and will be driving payments via in-house payment solutions and 3rd party integrations

Responsibilities

  • Own the strategic vision and product roadmap
  • Create a clear career path for your managers and the team beneath. Nurture and grow them with regular and deep
  • Contribute to product strategy, manage business goals and develop teams
  • Define simple and easy to use digital payments experience for tier 2/3/4 customers
  • Define user stories for end-to-end features
  • Regularly coordinate with multiple 3rd parties for integrations
  • Work closely with engineering teams and design teams to deliver the product to market on timelines
  • Define metrics to measure the health and success of all features

 

What are we looking for?

  • Have an entrepreneurial spirit and possess a total of 7 -8 years of experience and spent at least 4-5 years in product management of which must have spent at least 2 years in Indian payment ecosystem and a track record of creating innovative solutions
  • Demonstrated success as product manager for large-scale consumer-facing products
Demonstrated ability to think creatively, deal with ambiguity, and manage to change priorities
Read more
OJCommerce
at OJCommerce
3 recruiters
Rajalakshmi N
Posted by Rajalakshmi N
Chennai
2 - 5 yrs
₹7L - ₹12L / yr
Beautiful Soup
Web Scraping
skill iconPython
Selenium

Role : Web Scraping Engineer

Experience : 2 to 3 Years

Job Location : Chennai

About OJ Commerce: 


OJ Commerce (OJC), a rapidly expanding and profitable online retailer, is headquartered in Florida, USA, with a fully-functional office in Chennai, India. We deliver exceptional value to our customers by harnessing cutting-edge technology, fostering innovation, and establishing strategic brand partnerships to enable a seamless, enjoyable shopping experience featuring high-quality products at unbeatable prices. Our advanced, data-driven system streamlines operations with minimal human intervention.

Our extensive product portfolio encompasses over a million SKUs and more than 2,500 brands across eight primary categories. With a robust presence on major platforms such as Amazon, Walmart, Wayfair, Home Depot, and eBay, we directly serve consumers in the United States.

As we continue to forge new partner relationships, our flagship website, www.ojcommerce.com, has rapidly emerged as a top-performing e-commerce channel, catering to millions of customers annually.

Job Summary:

We are seeking a Web Scraping Engineer and Data Extraction Specialist who will play a crucial role in our data acquisition and management processes. The ideal candidate will be proficient in developing and maintaining efficient web crawlers capable of extracting data from large websites and storing it in a database. Strong expertise in Python, web crawling, and data extraction, along with familiarity with popular crawling tools and modules, is essential. Additionally, the candidate should demonstrate the ability to effectively utilize API tools for testing and retrieving data from various sources. Join our team and contribute to our data-driven success!


Responsibilities:


  • Develop and maintain web crawlers in Python.
  • Crawl large websites and extract data.
  • Store data in a database.
  • Analyze and report on data.
  • Work with other engineers to develop and improve our web crawling infrastructure.
  • Stay up to date on the latest crawling tools and techniques.



Required Skills and Qualifications:


  • Bachelor's degree in computer science or a related field.
  • 2-3 years of experience with Python and web crawling.
  • Familiarity with tools / modules such as
  • Scrapy, Selenium, Requests, Beautiful Soup etc.
  • API tools such as Postman or equivalent. 
  • Working knowledge of SQL.
  • Experience with web crawling and data extraction.
  • Strong problem-solving and analytical skills.
  • Ability to work independently and as part of a team.
  • Excellent communication and documentation skills.


What we Offer

• Competitive salary

• Medical Benefits/Accident Cover

• Flexi Office Working Hours

• Fast paced start up

Read more
MindHind
Vanish Jain
Posted by Vanish Jain
Remote only
5 - 10 yrs
₹10L - ₹15L / yr
skill iconC++
skill iconPython
skill iconNodeJS (Node.js)
We are looking for a C++ developer responsible for building applications that may range from desktop applications to native mobile applications and embedded systems. Your primary responsibility will be to design and develop these applications, and to coordinate with the rest of the team working on different layers of the infrastructure.
 
Responsibilities
Design, build, and maintain efficient, reusable, and reliable C++ code
Implement performance and quality modules
Identify bottlenecks and bugs, and devise solutions to these problems
Help maintain code quality, organization, and automatization
(Add other responsibilities here that are relevant)

Requirements
Skills
Strong proficiency in C++, with fair knowledge of the language specification
Thorough knowledge of the standard library, STL containers, and algorithms
(Specify any platform(s) that you want the developer to have a strong grasp of)
Good understanding of memory management in non-garbage collected environments
Understanding of dynamic polymorphism and C++ specific notions, such as friend classes
Familiarity with templating in C++
Knowledge of the latest C++11 standard is appreciated (depending on project specifications)
Familiarity with embedded systems design, low-level hardware interactions (if required)
Knowledge of low-level threading primitives and real-time environments (depending on project requirements)
Familiarity with system call wrapper library functions
Knowledge of writing native modules for high-level languages such as Node.js, Python, Go, etc. (if required)
Familiarity with language tools, such as Valgrind (if required)
Knowledge of component data sheets and specifications
Implementation of automated testing platforms and unit tests
Proficient understanding of code versioning tools (such as Git, SVN, and Mercurial)
Familiarity with continuous integration
(Make sure to mention other frameworks, libraries, or any other technology relevant to your project)
(List education level or certification you require)
Read more
World class experiential communications agency
World class experiential communications agency
Agency job
via Unnati by Veena Salian
Delhi, Noida, Gurugram
5 - 7 yrs
₹7L - ₹8L / yr
Recruitment/Talent Acquisition

Our client is a part of the world’s largest global communications group that enables renowned brands across industries and sectors to effectively realise their marketing goals by creating meaningful experiences & telling impactful stories. With four decades of experience it has effectively set benchmarks in every format- on-ground, virtual and hybrid.


This is India’s first end to end truly experiential agency and was founded by a pioneer who paved the way for corporate events in India.


As a Manager HR- TA Specialist, you will be responsible for finding, recruiting, hiring and retaining talented candidates. You'll be in charge of planning, developing and implementing a new and productive Talent Acquisition strategy for our company.

What you will do:

  • Investigating and determining employee needs
  • Developing a sustainable talent acquisition and hiring plan and strategies
  • Designing, planning and executing employer branding activities
  • Encouraging employees to be brand ambassadors
  • Planning employee referral programs
  • Using HRIS, Recruitment Marketing tools
  • Sourcing and finding candidates qualified for open positions
  • Performing analysis of hiring needs and providing employee hiring forecast
  • Designing, planning and executing selection processes (conducting interviews and screening calls, administering psychological tests etc.)
  • Reviewing employment applications and background check reports
  • Finding bottlenecks in the recruiting process
  • Performing candidate and employee satisfaction evaluations and workshops
  • Planning procedures for improving the candidate experience
  • Suggesting measures for improving employee retention
  • Leading, overseeing and supervising members of the recruiting team
  • Using sourcing methods for hard-to-fill roles
  • Attending career and college fairs, and similar events
  • Determining HR and recruiting KPIs
  • Creating and presenting KPI reports

 

Desired Candidate Profile

What you need to have:

  • MA in human resources, business administration or similar relevant field
  • 5+ years of experience as TA Manager or similar HR role
  • In-depth knowledge of full-cycle recruiting and employer branding techniques
  • Familiarity with a variety of different selection methods (interviews, assignments, psychological test etc.)
  • Hands on experience with posting jobs on social media and job boards
  • Experience with HRIS, ATS, Sourcing and Recruitment Marketing tools
  • Ability to motivate employees
  • A sense of ownership and pride in your performance and its impact on the company’s success
  • Problem-solving skills
  • Good time-management skills
  • Great interpersonal and communication skills
  • Strong knowledge of Human Resources law
Read more
studio diseno  sdtech
at studio diseno sdtech
1 recruiter
Akshaya S
Posted by Akshaya S
Pune
3 - 6 yrs
₹5L - ₹9L / yr
skill iconJava
skill iconSpring Boot
Microservices

About Studio Diseño

 

Humanising Technology!

 

We are a bunch of smart and passionate people looking to reinvent the possibilities when technology and design meet. We established ourselves as Studio Diseño in 2014 with strong aesthetics on digital screens and have evolved to be SD Tech by providing intuitive tech solutions for complex applications for business ranging from from startups to large Fortune 500 companies focusing more on Artificial Intelligence and Blockchain. We are agile and synergetic. We help our customers’ business upgrade and prosper with humanising technology.

 

Role : Java Backend developer

 

Job Description :

 

  • 3-5 years of extensive work experience in Java, with a good understanding of its ecosystems
  • Exposure on Core Java, Jsp, Servlets
  • Extensive Work Experience on frameworks like SpringBoot and Microservices
  • Understand requirements, formulate solutions, perform development and unit testing
  • Exposure on application development IDE like Eclipse, STS
  • Good command over Object Oriented Programming

 

Employment Type

Full-time

https://www.linkedin.com/talent/contract-chooser?contractId=330743753&;destUrl=https%3A%2F%2Fwww.linkedin.com%2Ftalent%2Fjob-posting%2Fonline%2Fdescription%3FjobId%3D3064722733">Edit job description
 
Read more
Vavia Technologies Pvt. Ltd.
Alan DSouza
Posted by Alan DSouza
Remote, Bengaluru (Bangalore)
6 - 11 yrs
₹15L - ₹24L / yr
skill iconRuby on Rails (ROR)
skill iconJavascript
MySQL
skill iconAmazon Web Services (AWS)
skill iconAngular (2+)
+1 more
We are a fast paced startup that has both inhouse products and provides technology consulting to other product companies as well. Given this, you will have deep exposure to a several innovative products.

However, Most importantly, you will need to be very passionate about building products and will need to thrive in a startup environment. 

Responsibilities - 
  • Architect, develop and maintain core products and services of the company.
  • Create database architecture and best practises for optimization in speed and product operating costs.
  • Design client-side and server-side architecture
  • Build the front-end of applications through appealing visual design
  • Develop and manage well-functioning databases and applications
  • Write effective APIs with high-volume large scale transaction processing capabilities.
  • Collaborate with design teams to ensure flawless UI and UX is achieved 
  • Build features and applications with a mobile responsive design
  • Write technical documentation
  • Test software to ensure responsiveness and efficiency
  • Work with customers in evaluating technical requirements.
  • Work closely with the product managers to achieve product vision and goals
  • Review work of other developers and contractors, provide feedback and mentoring.
  • Assist in the hiring of technical talent.

Requirements & Qualifications
  • Proven experience as a Full Stack Developer or similar role for atleast 3 years 
  • In depth knowledge of Ruby on Rails, NodeJS, ExpressJS or Restify
  • Experience implementing applications using Angular 1 or React
  • Experience creating front end applications using HTML5, Angular, LESS/SASS
  • Hands on experience with JavaScript Development on both client and server-side
  • Automating the building and deploying of code along with continuous integration (Jenkins/Hudson) and version control (SVN, Git)
  • Strong experience is deploying and managing application in AWS and Google Cloud
  • Creating secure RESTful-based web services in XML and JSON, Javascript, JQuery
  • Experience with modern frameworks and design patterns, minimum 2 years experience with MEAN Fullstack paradigm

Most important requirements and TLDR - 
  • Know how to create apis and applications
  • Know how to architect and scale databases
  • Know how to build front end for applications
  • Know how to deploy applications on the cloud
Read more
MSM Digital Private Limited
Rutuja Joshi
Posted by Rutuja Joshi
Pune
3 - 7 yrs
₹5L - ₹10L / yr
Game Testing (QA)
Selenium Web driver
Automatin Testing
ear Candidate, Currently we have requirement in our company. Below are the details of the position for your reference: Designation: Lead - Automation Testing Exp: 4-7 yrs out of which minimum 2 years of Selenium Automation is preferred. Skill Sets Required: Understanding of Functional and Regression Test Automation. Deep knowledge on Selenium suite of Tools (Selenium WebDriver and Selenium Grid). Good Knowledge of Java Programming (Data Types, Variables, Operators, Flow Control Statements). Good knowledge on Element Locators, Selenese Commands, WebDriver methods. Hands on Experience in designing keyword driven and data driven test automation frameworks and also page object model using selenium. Creating and Executing Test Cases (Test Scripts) using Selenium Webdriver, Java and TestNG Annotations. Analyzing Test Results and Root cause of failures + Troubleshooting independently. Defect Reporting and Tracking using any Defect Management Tool. Tracking Defects and Select Test cases for Regression Testing. (Match font in this line with others) Test Reporting Modifying Tests and performing Regression Testing. Experience in Designing and Documentation of the All kinds of Test Data and Environments required for Manual/Test Automation. Knowledge of Mobile App Testing on Android/iOS/Windows/Xamarin platforms. Should be able to manage and groom small team independently. If your profile is matching with the above skill sets please send me your updated resume on [email protected] Thanks & Regards, Sonal Mahajan +917447755500
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos