Data Engineer

Consulting and Services company

Data Engineer

Jobdost

Company

Home

Data Engineer

at Consulting and Services company

Agency job

via Jobdost

5 - 10 yrs

₹5L - ₹30L / yr (ESOP available)

Hyderabad, Ahmedabad

Skills

Amazon Web Services (AWS)

Apache

Python

PySpark

Data Engineer

Mandatory Requirements 

Experience in AWS Glue

Experience in Apache Parquet 
Proficient in AWS S3 and data lake 
Knowledge of Snowflake
Understanding of file-based ingestion best practices.
Scripting language - Python & pyspark

CORE RESPONSIBILITIES

Create and manage cloud resources in AWS 
Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform

Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
Define process improvement opportunities to optimize data collection, insights and displays.
Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
Identify and interpret trends and patterns from complex data sets

Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
Key participant in regular Scrum ceremonies with the agile teams  
Proficient at developing queries, writing reports and presenting findings 
Mentor junior members and bring best industry practices

QUALIFICATIONS

5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
Strong background in math, statistics, computer science, data science or related discipline
Advanced knowledge one of language: Java, Scala, Python, C# 
Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake

Proficient with
Data mining/programming tools (e.g. SAS, SQL, R, Python)
Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Data visualization (e.g. Tableau, Looker, MicroStrategy)
Comfortable learning about and deploying new technologies and tools.

Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
Good written and oral communication skills and ability to present results to non-technical audiences 
Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

AWS certification
Spark Streaming 
Kafka Streaming / Kafka Connect 
ELK Stack 
Cassandra / MongoDB

CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Data Engineer

Mandatory Requirements 

Experience in AWS Glue

Experience in Apache Parquet 
Proficient in AWS S3 and data lake 
Knowledge of Snowflake
Understanding of file-based ingestion best practices.
Scripting language - Python & pyspark

CORE RESPONSIBILITIES

Create and manage cloud resources in AWS 
Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 
Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform

Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 
Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
Define process improvement opportunities to optimize data collection, insights and displays.
Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 
Identify and interpret trends and patterns from complex data sets

Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 
Key participant in regular Scrum ceremonies with the agile teams  
Proficient at developing queries, writing reports and presenting findings 
Mentor junior members and bring best industry practices

QUALIFICATIONS

5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 
Strong background in math, statistics, computer science, data science or related discipline
Advanced knowledge one of language: Java, Scala, Python, C# 
Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake

Proficient with
Data mining/programming tools (e.g. SAS, SQL, R, Python)
Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Data visualization (e.g. Tableau, Looker, MicroStrategy)
Comfortable learning about and deploying new technologies and tools.

Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 
Good written and oral communication skills and ability to present results to non-technical audiences 
Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

AWS certification
Spark Streaming 
Kafka Streaming / Kafka Connect 
ELK Stack 
Cassandra / MongoDB

CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma

Full Stack Developer - Averlon

I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.

Companies hiring on Cutshort

Similar jobs

IT Recruiter

at Snapfind

Agency job

via TIGI HR Solution Pvt. Ltd. by Vaidehi Sarkar

Gurugram

0 - 1 yrs

₹1L - ₹2L / yr

Human Resources (HR)

Recruitment

Client Management

🎯 What We’re Looking For:

✔️ 6+ months experience in recruitment, preferably with IT roles

✔️ Familiarity with tech profiles (Developers, QA, DevOps, etc.)

✔️ Strong communication skills and a hunger to learn.

✔️ Bachelor's degree in HR / Business / IT or related field (preferred).

Stipend -: 10K - 15K / Month (Depends upon the interview)

Working Days -: 5.5 Days (Alternate Saturdays will be Off)

Based on Performance, Full-Time opportunity will be provided post completion of the Internship.

Mandatory Criteria (Can't be neglected during screening) :

1. IT Recruitment Knowledge

– Minimum 3 Months of Recruitment Experience in screening, and coordinating interviews especially in IT.

– Understanding of common IT roles (e.g., Developers, QA, DevOps, Data Analysts) and basic tech stacks (like Java, Python, .NET, AWS, etc.)

– Understanding of tech stacks, keywords, and job requirements

2. Basic Understanding of IT Roles & Technologies

– Knowing the difference between front-end, back-end, full-stack, etc.

– Able to read and understand tech job descriptions.

– Comfort in learning new IT terminologies and understanding client needs.

🎯 What We’re Looking For:

✔️ 6+ months experience in recruitment, preferably with IT roles

✔️ Familiarity with tech profiles (Developers, QA, DevOps, etc.)

✔️ Strong communication skills and a hunger to learn.

✔️ Bachelor's degree in HR / Business / IT or related field (preferred).

Stipend -: 10K - 15K / Month (Depends upon the interview)

Working Days -: 5.5 Days (Alternate Saturdays will be Off)

Based on Performance, Full-Time opportunity will be provided post completion of the Internship.

Mandatory Criteria (Can't be neglected during screening) :

1. IT Recruitment Knowledge

– Minimum 3 Months of Recruitment Experience in screening, and coordinating interviews especially in IT.

– Understanding of common IT roles (e.g., Developers, QA, DevOps, Data Analysts) and basic tech stacks (like Java, Python, .NET, AWS, etc.)

– Understanding of tech stacks, keywords, and job requirements

2. Basic Understanding of IT Roles & Technologies

– Knowing the difference between front-end, back-end, full-stack, etc.

– Able to read and understand tech job descriptions.

– Comfort in learning new IT terminologies and understanding client needs.

Senior Product Designer

QR code platform

Agency job

via Qrata by Blessy Fernandes

Bengaluru (Bangalore)

2 - 10 yrs

₹20L - ₹30L / yr

Product design

Adobe XD

Sketch

User Experience (UX) Design

SaaS

Job responsibilities:

Partner closely with Product Design, Engineering, and Product Management to understand requirements and deliver product features and roadmap as envisioned by stakeholders.
Own end-to-end user journey and all aspects of design execution from ideation, to prototyping, to user acceptance testing of product design tasks assigned.
Conduct user interviews, user testing sessions, card sorting, and affinity mapping, conduct both qualitative and quantitative tests, and analyze the data.
Design high-impact, functional responsive interfaces for web and mobile
Collaborate with other designers and participate in our design critique process, to receive and provide feedback on design work

Skills you bring to the table:

Experience in designing SaaS products with large customer bases
Deep expertise using Figma/Xd/Sketch, and familiarity with design systems
Knowledge of Carbon - IBM's Design system or experience building a design system from scratch is a plus.
Fundamental understanding of the end-to-end iterative UX design process — research, ideation, information architecture, prototyping, validation, and refining solutions into pixel-perfect deliverables.
Ability to articulate design decisions throughout the user-centered design process.
Ability to update and engage with stakeholders like product managers and engineers.
Relevant fundamental knowledge of front-end technologies to collaborate with UI engineering teams will be an advantage.

If you are interested in working for a fast-growing SaaS company operating in an exciting new space, this one is for you!

Job responsibilities:

Partner closely with Product Design, Engineering, and Product Management to understand requirements and deliver product features and roadmap as envisioned by stakeholders.
Own end-to-end user journey and all aspects of design execution from ideation, to prototyping, to user acceptance testing of product design tasks assigned.
Conduct user interviews, user testing sessions, card sorting, and affinity mapping, conduct both qualitative and quantitative tests, and analyze the data.
Design high-impact, functional responsive interfaces for web and mobile
Collaborate with other designers and participate in our design critique process, to receive and provide feedback on design work

Skills you bring to the table:

Experience in designing SaaS products with large customer bases
Deep expertise using Figma/Xd/Sketch, and familiarity with design systems
Knowledge of Carbon - IBM's Design system or experience building a design system from scratch is a plus.
Fundamental understanding of the end-to-end iterative UX design process — research, ideation, information architecture, prototyping, validation, and refining solutions into pixel-perfect deliverables.
Ability to articulate design decisions throughout the user-centered design process.
Ability to update and engage with stakeholders like product managers and engineers.
Relevant fundamental knowledge of front-end technologies to collaborate with UI engineering teams will be an advantage.

If you are interested in working for a fast-growing SaaS company operating in an exciting new space, this one is for you!

Hr Recruiter

at Blue Star Diamonds Pvt Ltd

Posted by SIDDHI PHATAK

Surat

3 - 4 yrs

₹3L - ₹4L / yr

Recruitment

Recruitment/Talent Acquisition

Talent management

We at AURO MANUFACTURING PVT. LTD. is looking for a Recruiter.

Job role -

- End-to-end recruitment.

- Sourcing profiles through job portals & consultants.

- Hiring through job portals as well as through consultants.

- Screening profiles.

- Conducting interviews.

- Negotiating salary.

Skills -

- Good interpersonal skills.

- Good communication skills.

- Moderate Excel skills.

Education - Any Graduation (full-time)

Experience – 2-3Years (as a recruiter)

Job location - F P No. 37 / F P No. 65/B/2 Umiya Chowk,

Ashwinikumar Road, Varachha, Surat 395 008, India.

We at AURO MANUFACTURING PVT. LTD. is looking for a Recruiter.

Job role -

- End-to-end recruitment.

- Sourcing profiles through job portals & consultants.

- Hiring through job portals as well as through consultants.

- Screening profiles.

- Conducting interviews.

- Negotiating salary.

Skills -

- Good interpersonal skills.

- Good communication skills.

- Moderate Excel skills.

Education - Any Graduation (full-time)

Experience – 2-3Years (as a recruiter)

Job location - F P No. 37 / F P No. 65/B/2 Umiya Chowk,

Ashwinikumar Road, Varachha, Surat 395 008, India.

Android Developer

E-commerce Company

Agency job

via Vmultiply solutions by HR Lakshmi

Bengaluru (Bangalore)

2 - 3 yrs

₹3L - ₹12L / yr

Android Development

Kotlin

Java

Android Developers with good experience in Kotlin. Experience in Swift/AR core / ARkit will be added advantage.
Note: Candidates from Premium Institutions are preferred

Junior Graphic Designer

Disruptive Fashion Commerce Company

Agency job

via Unnati by Astha Bharadwaj

Bengaluru (Bangalore)

1 - 1.5 yrs

₹3L - ₹3.5L / yr

Graphic Designing

Graphic Designer

Video Making

Image editing

Adobe After Effects

+6 more

Do you want to be part of a rapidly growing fashion start up and experience the fast paced growth in your career along with being up to date with fashion? Then read on.

Our client is a Community Commerce company that focuses on fashion and accessories. Their community network and technology is leading a rejig of Fashion retail and supply chain in India. Their network creates users as buyers and sellers at the same time, offering unbeatable prices on products and rewards for sharing deals across social media.

The founders are alumnus of prestigious tech and business institutes, with expertise and experience with ECommerce and distribution facilities. They have ensured quality and fashion with the factory price tag, that works best when shared rapidly with communities on social networking.

As a Junior Graphic Designer, you will help in communicating the values & offerings via marketing campaigns by creating meaningful designs. For this role, you will collaborate with a cross-functional team to ensure our branding and design language is consistent & creative.

What you will do:

Collaborating with the marketing team to understand and deliver design-related requirements.
Making highly creative and intuitive images/ videos for various marketing campaigns.
Creating highly appealing creatives for social media posts & campaigns.
Using design software to refine illustrations and designs.
Developing prototypes to ensure a consistent, integrated brand perception.
Supporting marketing team with effective time and task management.

What you need to have:

Bachelor’s degree in graphic design or equivalent qualification.
1-1.5 years of professional experience in designing.
Weightage will be given to project and hands-on experience than educational qualifications.
The designer needs to be adherent to details, efficient, adaptive to a fast-paced environment & ready to take responsibilities
Well organized, responsible and dedicated, with the ability to work on multiple projects and deliver refined design in a short time.
Self-learning, able to learn new tools quickly and work in a fast-evolving environment.
Mandatory proficiency in Adobe Photoshop, Illustrator. Adobe After Effects will be a value addition but not mandatory.
Expert level skills in Photoshop, Illustrator in and other relevant design tools.

Core competencies/ skills:

Strong design and software skills
Creative with an eye for detail
(Portfolio has to be mandatorily shared)

What you will do:

Collaborating with the marketing team to understand and deliver design-related requirements.
Making highly creative and intuitive images/ videos for various marketing campaigns.
Creating highly appealing creatives for social media posts & campaigns.
Using design software to refine illustrations and designs.
Developing prototypes to ensure a consistent, integrated brand perception.
Supporting marketing team with effective time and task management.

What you need to have:

Bachelor’s degree in graphic design or equivalent qualification.
1-1.5 years of professional experience in designing.
Weightage will be given to project and hands-on experience than educational qualifications.
The designer needs to be adherent to details, efficient, adaptive to a fast-paced environment & ready to take responsibilities
Well organized, responsible and dedicated, with the ability to work on multiple projects and deliver refined design in a short time.
Self-learning, able to learn new tools quickly and work in a fast-evolving environment.
Mandatory proficiency in Adobe Photoshop, Illustrator. Adobe After Effects will be a value addition but not mandatory.
Expert level skills in Photoshop, Illustrator in and other relevant design tools.

Core competencies/ skills:

Strong design and software skills
Creative with an eye for detail
(Portfolio has to be mandatorily shared)

Sr. UI/UX Designer

at Deforus Technologies Pvt Ltd

1 recruiter

Posted by Krunal Salvi

Mumbai

2 - 5 yrs

₹6L - ₹12L / yr

User Interface (UI) Design

User Experience (UX) Design

Mobile App Design

Web design

Adobe XD

+11 more

We are looking for a full-time User Interface and User Experience Designer to join our growing team.

Qualification Required:

Proven work experience as a UI/UX Designer.
Minimum 3 to 7 years of experience designing interfaces for mobile and web applications.
Portfolio of a design project.
Up-to-date knowledge of design software like Adobe XD, Illustrator, and photoshop.
Team spirit: strong communication skills to collaborate with various clients.
Good time management skills.
Thinker and problem-solving skills.

Responsibilities:

Executing all visual design stages from concept to final hand-off to the client.
Conceptualizing original ideas that bring simplicity with user-friendliness to the complex design.
Create wireframes, storyboards, user flows, process flows and site maps to effectively communicate interaction and design ideas.
Combine creativity with an awareness of the design elements.
Conduct ongoing user research.
Don't forget to attach previous work or Behance portfolio link.

Regards,
Deforus Technologies Pvt. Ltd.

We are looking for a full-time User Interface and User Experience Designer to join our growing team.

Qualification Required:

Proven work experience as a UI/UX Designer.
Minimum 3 to 7 years of experience designing interfaces for mobile and web applications.
Portfolio of a design project.
Up-to-date knowledge of design software like Adobe XD, Illustrator, and photoshop.
Team spirit: strong communication skills to collaborate with various clients.
Good time management skills.
Thinker and problem-solving skills.

Responsibilities:

Executing all visual design stages from concept to final hand-off to the client.
Conceptualizing original ideas that bring simplicity with user-friendliness to the complex design.
Create wireframes, storyboards, user flows, process flows and site maps to effectively communicate interaction and design ideas.
Combine creativity with an awareness of the design elements.
Conduct ongoing user research.
Don't forget to attach previous work or Behance portfolio link.

Regards,
Deforus Technologies Pvt. Ltd.

Senior Frontend Developer

at Srijan Technologies

6 recruiters

Posted by Vidhie Gupta

Remote only

5 - 10 yrs

₹10L - ₹15L / yr

Javascript

React.js

HTML/CSS

NodeJS (Node.js)

Skills:

Minimum 5 years of experience as a Front-end Developer
Responsive/Mobile Design Skills
Cross-Browser Development
JavaScript frameworks like NodeJS, ReactJS etc.
Front End Frameworks like Bootstrap
Worked on markup languages like HTML, HTML5
Worked on JavaScript, CSS and jQuery
Excellent knowledge of browser troubleshooting and debugging practices and techniques
Knowledge of some SEO principles
Knowledge of graphics software such as Adobe Suite, Photoshop etc.
Sense of ownership and pride in your performance and its impact on company’s success
Critical thinker and problem-solving skills
Team player
Good time-management skills
Good interpersonal and communication skills

To know more about Srijan Technologies, visit the following:

Website: http://www.srijan.net/">http://www.srijan.net/

Twitter: https://twitter.com/Srijan">https://twitter.com/Srijan

LinkedIn: https://www.linkedin.com/company/srijan-technologies-pvt--ltd-">https://www.linkedin.com/company/srijan-technologies-pvt--ltd-

Facebook: https://www.facebook.com/SrijanOne

Skills:

Minimum 5 years of experience as a Front-end Developer
Responsive/Mobile Design Skills
Cross-Browser Development
JavaScript frameworks like NodeJS, ReactJS etc.
Front End Frameworks like Bootstrap
Worked on markup languages like HTML, HTML5
Worked on JavaScript, CSS and jQuery
Excellent knowledge of browser troubleshooting and debugging practices and techniques
Knowledge of some SEO principles
Knowledge of graphics software such as Adobe Suite, Photoshop etc.
Sense of ownership and pride in your performance and its impact on company’s success
Critical thinker and problem-solving skills
Team player
Good time-management skills
Good interpersonal and communication skills

To know more about Srijan Technologies, visit the following:

Website: http://www.srijan.net/">http://www.srijan.net/

Twitter: https://twitter.com/Srijan">https://twitter.com/Srijan

LinkedIn: https://www.linkedin.com/company/srijan-technologies-pvt--ltd-">https://www.linkedin.com/company/srijan-technologies-pvt--ltd-

Facebook: https://www.facebook.com/SrijanOne

Scala Developer

at Unifytech

20 recruiters

Posted by Sunil Bolisetty

Mumbai

4 - 10 yrs

₹4L - ₹30L / yr

Scala

Java

Python

Should be very strong Scala development(Coding)
With Any combination of Java/Python/Spark/Bigdata
3+ years experience in Core Java/Scala with good understanding of multithreading
The candidate must be good with Computer Science fundamentals
Exposure to python/perl and Unix / K-Shell scripting
Code management tools such as Git/Perforce.
Experience with large batch-oriented systems
DB2/Sybase or any RDBMS
Prior experience with financial products, particularly OTC Derivatives
Exposure to counterparty risk, margining, collateral or confirmation systems

Should be very strong Scala development(Coding)
With Any combination of Java/Python/Spark/Bigdata
3+ years experience in Core Java/Scala with good understanding of multithreading
The candidate must be good with Computer Science fundamentals
Exposure to python/perl and Unix / K-Shell scripting
Code management tools such as Git/Perforce.
Experience with large batch-oriented systems
DB2/Sybase or any RDBMS
Prior experience with financial products, particularly OTC Derivatives
Exposure to counterparty risk, margining, collateral or confirmation systems

Sales Manager

at Prosavinns Pvt Ltd

1 recruiter

Posted by Ashish thakur

Nagpur

2 - 5 yrs

₹1.8L - ₹3L / yr

Channel Sales

Business Development

Sales

Presales

Telesales

This is a healthcare and Pharma Sector related startup, we are basically looking for people with zeal to prove themselves. Any experience in Pharma sector would be a boon. The person will be required to develop buisness and do onfield calls to get customers enrolled on to this platform. Equity option is available depending upon the efficiency.

PHP Developer - CodeIgniter/Laravel/CakePHP

at Mobzway Technologies LLP

2 recruiters

Posted by Aishwarya Jayan

Jaipur

0 - 3 yrs

₹1L - ₹7L / yr

CakePHP

PHP

CodeIgniter

Laravel

Description :- We are looking for a PHP developer responsible for building Web applications. This includes anything between complex groups of back-end services and their client-end (desktop and mobile) counterparts. - Your primary responsibility will be to design and develop these applications, and to coordinate with the rest of the team working on different layers of the infrastructure. - Thus, a commitment to collaborative problem solving, sophisticated design, and product quality is essential.Skills Required :- Proven software development experience in PHP& MySQL.- Strong skills in Laravel, CodeIgniter or CakePHP framework.- Good Knowledge of creating database schemas & Stored Procedure that represent and support business processes.- Knowledge of AngularJS and NodeJS would be preferable.- Experience in common third-party APIs (Google, Facebook etc.)- Demonstrable knowledge of web technologies including HTML, CSS, JavaScript, AJAX etc- Passion for best design and coding practices and a desire to develop new bold ideas Demonstrable.- Understanding fundamental design principles behind a scalable application.- Strong understanding of object-oriented programming.- Familiarity with current design and architectural patterns.- Knack for writing clean, readable, and easily maintainable code.

Why apply to jobs via Cutshort