Cutshort logo
Consulting and Services company logo
Data Engineer
Consulting and Services company
Data Engineer
Consulting and Services company's logo

Data Engineer

at Consulting and Services company

Agency job
5 - 10 yrs
₹5L - ₹30L / yr (ESOP available)
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
skill iconPython
PySpark

Data Engineer 

  

Mandatory Requirements  

  • Experience in AWS Glue 
  • Experience in Apache Parquet  
  • Proficient in AWS S3 and data lake  
  • Knowledge of Snowflake 
  • Understanding of file-based ingestion best practices. 
  • Scripting language - Python & pyspark 

 

CORE RESPONSIBILITIES 

  • Create and manage cloud resources in AWS  
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies  
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform  
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations  
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data. 
  • Define process improvement opportunities to optimize data collection, insights and displays. 
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible  
  • Identify and interpret trends and patterns from complex data sets  
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.  
  • Key participant in regular Scrum ceremonies with the agile teams   
  • Proficient at developing queries, writing reports and presenting findings  
  • Mentor junior members and bring best industry practices  

 

QUALIFICATIONS 

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)  
  • Strong background in math, statistics, computer science, data science or related discipline 
  • Advanced knowledge one of language: Java, Scala, Python, C#  
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake   
  • Proficient with 
  • Data mining/programming tools (e.g. SAS, SQL, R, Python) 
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum) 
  • Data visualization (e.g. Tableau, Looker, MicroStrategy) 
  • Comfortable learning about and deploying new technologies and tools.  
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.  
  • Good written and oral communication skills and ability to present results to non-technical audiences  
  • Knowledge of business intelligence and analytical tools, technologies and techniques. 

 

Familiarity and experience in the following is a plus:  

  • AWS certification 
  • Spark Streaming  
  • Kafka Streaming / Kafka Connect  
  • ELK Stack  
  • Cassandra / MongoDB  
  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools 
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

NeoGenCode Technologies Pvt Ltd
Akshay Patil
Posted by Akshay Patil
Gurugram
6 - 10 yrs
₹12L - ₹22L / yr
Data engineering
Azure Data Factory (ADF)
Azure Cloud Services
SQL
Data modeling
+10 more

Job Title : Senior Data Engineer

Experience : 6 to 10 Years

Location : Gurgaon (Hybrid – 3 days office / 2 days WFH)

Notice Period : Immediate to 30 days (Buyout option available)


About the Role :

We are looking for an experienced Senior Data Engineer to join our Digital IT team in Gurgaon.

This role involves building scalable data pipelines, managing data architecture, and ensuring smooth data flow across the organization while maintaining high standards of security and compliance.


Mandatory Skills :

Azure Data Factory (ADF), Azure Cloud Services, SQL, Data Modelling, CI/CD tools, Git, Data Governance, RDBMS & NoSQL databases (e.g., SQL Server, PostgreSQL, Redis, ElasticSearch), Data Lake migration.


Key Responsibilities :

  • Design and develop secure, scalable end-to-end data pipelines using Azure Data Factory (ADF) and Azure services.
  • Build and optimize data architectures (including Medallion Architecture).
  • Collaborate with cross-functional teams on cybersecurity, data privacy (e.g., GDPR), and governance.
  • Manage structured/unstructured data migration to Data Lake.
  • Ensure CI/CD integration for data workflows and version control using Git.
  • Identify and integrate data sources (internal/external) in line with business needs.
  • Proactively highlight gaps and risks related to data compliance and integrity.

Required Skills :

  • Azure Data Factory (ADF)Mandatory
  • Strong SQL and Data Modelling expertise.
  • Hands-on with Azure Cloud Services and data architecture.
  • Experience with CI/CD tools and version control (Git).
  • Good understanding of Data Governance practices.
  • Exposure to ETL/ELT pipelines and Data Lake migration.
  • Working knowledge of RDBMS and NoSQL databases (e.g., SQL Server, PostgreSQL, Redis, ElasticSearch).
  • Understanding of RESTful APIs, deployment on cloud/on-prem infrastructure.
  • Strong problem-solving, communication, and collaboration skills.

Additional Info :

  • Work Mode : Hybrid (No remote); relocation to Gurgaon required for non-NCR candidates.
  • Communication : Above-average verbal and written English skills.

Perks & Benefits :

  • 5 Days work week
  • Global exposure and leadership collaboration.
  • Health insurance, employee-friendly policies, training and development.
Read more
Sonatype
at Sonatype
5 candid answers
Reshika Mendiratta
Posted by Reshika Mendiratta
Hyderabad
5 - 8 yrs
Upto ₹28L / yr (Varies
)
ETL
skill iconPython
skill iconJava
databricks
SQL
+7 more

Who We Are

At Sonatype, we help organizations build better, more secure software by enabling them to understand and control their software supply chains. Our products are trusted by thousands of engineering teams globally, providing critical insights into dependency health, license risk, and software security. We’re passionate about empowering developers—and we back it with data.


The Opportunity

We’re looking for a Data Engineer with full stack expertise to join our growing Data Platform team. This role blends data engineering, microservices, and full-stack development to deliver end-to-end services that power analytics, machine learning, and advanced search across Sonatype.

You will design and build data-driven microservices and workflows using Java, Python, and Spring Batch, implement frontends for data workflows, and deploy everything through CI/CD pipelines into AWS ECS/Fargate. You’ll also ensure services are monitorable, debuggable, and reliable at scale, while clearly documenting designs with Mermaid-based sequence and dataflow diagrams.

This is a hands-on engineering role for someone who thrives at the intersection of data systems, fullstack development, ML, and cloud-native platforms.


What You’ll Do

  • Design, build, and maintain data pipelines, ETL/ELT workflows, and scalable microservices.
  • Development of complex web scraping (Playwright) and realtime pipelines (Kafka/Queues/Flink).
  • Develop end-to-end microservices with backend (Java 5+, Python 5+, Spring Batch 2+) and frontend (React or any).
  • Deploy, publish, and operate services in AWS ECS/Fargate using CI/CD pipelines (Jenkins, GitOps).
  • Architect and optimize data storage models in SQL (MySQL, PostgreSQL) and NoSQL stores.
  • Implement web scraping and external data ingestion pipelines.
  • Enable Databricks and PySpark-based workflows for large-scale analytics.
  • Build advanced data search capabilities (fuzzy matching, vector similarity search, semantic retrieval).
  • Apply ML techniques (scikit-learn, classification algorithms, predictive modeling) to data-driven solutions.
  • Implement observability, debugging, monitoring, and alerting for deployed services.
  • Create Mermaid sequence diagrams, flowcharts, and dataflow diagrams to document system architecture and workflows.
  • Drive best practices in fullstack data service development, including architecture, testing, and documentation.


What We’re Looking For


Minimum Qualifications

  • 2+ years of experience as a Data Engineer or a Software Backend engineering role
  • Strong programming skills in Python, Scala, or Java
  • Hands-on experience with HBase or similar NoSQL columnar stores
  • Hands-on experience with distributed data systems like Spark, Kafka, or Flink
  • Proficient in writing complex SQL and optimizing queries for performance
  • Experience building and maintaining robust ETL/ELT pipelines in production
  • Familiarity with workflow orchestration tools (Airflow, Dagster, or similar)
  • Understanding of data modeling techniques (star schema, dimensional modeling, etc.)
  • Familiarity with CI/CD pipelines (Jenkins or similar)
  • Ability to visualize and communicate architectures using Mermaid diagrams

Bonus Points

  • Experience working with Databricks, dbt, Terraform, or Kubernetes
  • Familiarity with streaming data pipelines or real-time processing
  • Exposure to data governance frameworks and tools
  • Experience supporting data products or ML pipelines in production
  • Strong understanding of data privacy, security, and compliance best practices


Why You’ll Love Working Here

  • Data with purpose: Work on problems that directly impact how the world builds secure software
  • Modern tooling: Leverage the best of open-source and cloud-native technologies
  • Collaborative culture: Join a passionate team that values learning, autonomy, and impact
Read more
Our client is a leading interior design and execution studio
Our client is a leading interior design and execution studio
Agency job
via PeopleX Ventures by Janhavi Dharamraj Saroj
HSR Layout, Bangalore, Karnataka
1 - 10 yrs
₹5L - ₹6L / yr
Communication Skills

Location: HSR Layout, Bangalore

Work Days: Tuesday to Sunday (Monday weekly off)

About the Company:

Our client is a leading interior design and execution studio based in HSR Layout, Bangalore. The studio specializes in premium residential projects, blending creativity with functionality to deliver beautiful, personalized homes. With a strong focus on design excellence, quality execution, and customer experience, the team is dedicated to transforming living spaces into dream homes.

Role Overview:

We are looking for a Receptionist who will serve as the first point of contact at our studio. This role goes beyond managing the front desk—it is about creating a welcoming and professional experience for clients, visitors, and partners. The right candidate will be warm, approachable, well-spoken, and skilled at handling calls, appointments, and administrative coordination with efficiency.

Key Responsibilities:

  • Greet and welcome visitors in a warm, professional manner
  • Answer and manage phone calls, emails, and walk-in inquiries
  • Maintain a clean, organized, and welcoming reception area
  • Schedule and manage client appointments
  • Coordinate courier and delivery activities
  • Provide basic administrative support to the team as needed

Qualifications:

  • Excellent communication skills in English and Hindi.
  • Presentable, approachable, and customer-focused personality
  • Prior experience as a receptionist/front desk executive preferred
  • Strong organizational and multitasking abilities

Job Types: Full-time, Permanent

Work Location: In person

Read more
Devmonk
at Devmonk
1 recruiter
Naimish Rajput
Posted by Naimish Rajput
Remote, Ahmedabad
2 - 4 yrs
₹3L - ₹8L / yr
skill iconAngular (2+)
skill iconAngularJS (1.x)
skill iconHTML/CSS
User Interface (UI) Design
Strong proficiency with JavaScript.
Hands-on working experience and knowledge of Angular, HTML, CSS, Development experience designing object-oriented JavaScript. 
Basic understanding of front-end technologies, such as HTML5 and AJAX. Integration of user-facing (Angular) elements developed by front-end developers. Writing reusable, testable, and efficient code.
Design and implementation of low-latency, high availability, and familiarity with the whole web stack, including protocols and web server optimization techniques. 
Identify the interaction needs and how the API. must be developed based on design comps, product specs, etc.
Continuously evaluate and implement new technologies to maximize development efficiency.
Address and prioritize production level bugs and application performance improvements.
An adaptable attitude and understanding of the agile methodology.
Unit-test code for robustness, including edge cases, usability, and general reliability.
Collaborate with cross-functional teams to define, design, and release new features.
Strong communication skills, including the ability to both, collaborate well and also the ability to convey technical ideas and concepts to non-technical stakeholders.
Read more
Fintech Domain
Fintech Domain
Agency job
via anzy global by Makawana Raj Ashwinbhai
Mumbai
5 - 7 yrs
₹20L - ₹40L / yr
skill iconJavascript
skill iconAngular (2+)
skill iconReact.js
skill iconAngularJS (1.x)
skill iconVue.js
+7 more
About the company
Cashflo is India's first-of-its-kind Exchange for Working Capital that, on the one hand,helps vendors
to large corporates get access to affordable short-term capital at the click of a button, while on the
other hand, Cashflo helps the corporates to optimize their working capital & treasury returns.
Job Description
Cashflo, true to its name, is on a mission to unlock $100+ billions of trapped working capital in the
economy by creating India’s largest marketplace for invoice discounting to solve the day-to-day.
Cashflow problems faced by businesses. Founded by ex-BCG and ISB / IIM alumni, and backed by
SAIF Partners, Cashflo helps democratize access to credit in a fair and transparent manner.
Awarded Supply Chain Finance solution of the year in 2019, Cashflo creates a win-win ecosystem
for Buyers, suppliers and financiers through its unique platform model. Cashflo shares its parentage
with HCS Ltd., a 25-year-old, highly reputed financial services company has raised over Rs. 15,000

Crores in the market till date, for over 200 corporate clients. Our leadership team consists of ex-
BCG, ISB / IIM alumni with a team of industry veterans from financial services serving as the

advisory board. We bring to the table deep insights in the SME lending space, based on 100+
years of combined experience in Financial Services. We are a team of passionate problem solvers,
and are looking for like-minded people to join our team.

The challenge
 Solve a complex $300+ billion problem at the cutting edge of Fintech innovation, and make a
tangible difference to the small business landscape in India.
 Find innovative solutions for problems in a yet to be discovered market.

Key Responsibilities
 As an early team member, you will get a chance to set the foundations of our engineering
culture. You will help articulate our engineering principles and help set the long-term
roadmap.
 Making decisions on the evolution of Cashflo's technical architecture
 Building new features end to end, from talking to customers to writing code

Our Ideal Candidate Will Have
 3+ years of full-time frontend software engineering experience
 Experience building frontends for SaaS products (you've owned & built features from start to
finish before)
 Thorough knowledge of SDLC
 Extensive knowledge of React/Angular or similar frameworks.
 Hands-on knowledge of CSS & design systems such as Tailwind, Ant Design, etc.
 Experience writing automated tests
 Been part of teams that have maintained large frontend codebases

About You

Product-minded. You have a sense for great user experience and feel for when something is off.
You love understanding customer pain points and solving for them.
Get a lot done. You enjoy all aspects of building a product and are comfortable moving across the
stack when necessary. You problem solve independently and enjoy figuring stuff out.
High conviction. When you commit to something, you're in all the way. You're opinionated, but
you know when to disagree and commit. Mediocrity is the worst of all possible outcomes.
What’s in it for me
 Gain exposure to the Fintech space - one of the largest and fastest growing markets in
India and globally.
 Shape India’s B2B Payments landscape through cutting edge technology innovation.
 Be directly responsible for driving company’s success.
 Join a high performance, dynamic and collaborative work environment that throws new
challenges on a daily basis.
 Fast track your career with trainings, mentoring, growth opportunities on both IC and
management track.
 Work-life balance and fun team events.
Read more
Coddle Technologies
at Coddle Technologies
5 recruiters
Sara Jaise
Posted by Sara Jaise
Bengaluru (Bangalore), Calicut
0 - 4 yrs
₹2L - ₹6L / yr
User Interface (UI) Design
User Experience (UX) Design
skill iconAdobe XD
Adobe Photoshop
skill iconAdobe Illustrator
+3 more

UI-UX Designer (2 Months to 4 years)

Work From Office

Bengaluru and Calicut

Our company is looking for an experienced and ambitious UI-UX Designer with experience in designing tools like Figma, AdobeXD, Photoshop and Illustrator

Skills required-

  • Photoshop
  • Illustrator 
  • Figma
  • Adobe XD
  • Zeplin/Invision 
  • Knowledge in Responsive design
  • HTML and CSS
  • Bootstrap

Main Responsibilities of a UI/UX Designer

  • Create user centred designs by understanding business requirements and user feedback
  • Creating user flows, wireframes, prototypes and mock-ups
  • Translating requirements into style guides, design systems, design patterns and attractive user interfaces
Read more
Intergral Add Science
Intergral Add Science
Agency job
via Vipsa Talent Solutions by Prashma S R
Pune
5 - 8 yrs
₹9L - ₹25L / yr
skill iconJava
Hadoop
Apache Spark
skill iconScala
skill iconPython
+3 more
  • 6+ years of recent hands-on Java development
  • Developing data pipelines in AWS or Google Cloud
  • Java, Python, JavaScript programming languages
  • Great understanding of designing for performance, scalability, and reliability of data intensive application
  • Hadoop MapReduce, Spark, Pig. Understanding of database fundamentals and advanced SQL knowledge.
  • In-depth understanding of object oriented programming concepts and design patterns
  • Ability to communicate clearly to technical and non-technical audiences, verbally and in writing
  • Understanding of full software development life cycle, agile development and continuous integration
  • Experience in Agile methodologies including Scrum and Kanban
Read more
Byjus
Byjus
Agency job
via Agile Hire by Satyadev Anupindi
Bengaluru (Bangalore)
4 - 7 yrs
₹15L - ₹30L / yr
skill iconJava
skill iconGo Programming (Golang)
Data Structures
Algorithms

Requirements:

  • Solid experience in Java or Golang
  • Good to have exposure to ML
  • Should have experience in cloud computing
  • Has an ability to quickly learn and contribute in multiple codebase
  • Overcomes roadblocks and requires minimal oversight
  • Takes initiatives to fix issues/tech debts before assigned to him/her
  • Able to deep dive into codebase and advise QA of possible regression impact
  • Communicates tech decisions through design docs and tech talks
  • Has delivered projects with end-to-end accountability
  • Keeps track of industry trends and introduces right tech/tools for a given job
  • Excellent understanding of software engineering practices, Design Patterns, Data Structures, Algorithms
  • 4+ years of experience in product driven organisation
  • A Bachelors or Masters degree in engineering from a reputed institute (preferably IITs, NITs, or other top engineering institutes)
Read more
mPokket is an mobile app based lending platform.
mPokket is an mobile app based lending platform.
Agency job
via Success Pact by Himanshu Sati
Bengaluru (Bangalore)
6 - 15 yrs
₹10L - ₹80L / yr
skill iconPHP
skill iconPython
skill iconLaravel
skill iconCodeIgniter
skill iconCakePHP
Tech Lead / Sr. Tech Lead / SDE-I / II We need you to have a minimum of 6 years of experience with the following: Leadership
 Managing & mentoring a team of 5+ people
 Ability to deliver projects/sprints on time
 Obsessed with quality: Design reviews, code reviews, testing (system/performance)
 Spending at least 50% time with hands-on coding while doing the above
Programming
 Hands on experience with design and implementation of of WebApps and APIs using a PHP based framework (such as Laravel, Code Igniter, Cake or similar)
 In addition to PHP, hands-on with a Python or node.js based framework
 Good understanding of SQL (mySQL, postgres or similar. including clustering)
 Good understanding of one no-SQL
 Comfortable producing and refactoring code without assistance
 Understands different major language paradigms (object oriented / functional /reactive)
 Can reason about complexity of algorithms (time and space)
 Basic CI/CD and DevOps
Read more
Paper Plane Tales
at Paper Plane Tales
1 recruiter
Janavi Parikh
Posted by Janavi Parikh
Remote, Mumbai
1 - 4 yrs
₹2L - ₹8L / yr
Operations
Vendor Management
Finance
Business Development
The candidate will aid in day to day business operations, financial planning and management and vendor management.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos