Cutshort logo
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Product and Service based company's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Mumbai
1 - 2 yrs
₹2L - ₹4L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+10 more

Responsibilities:

  • Develop and maintain dynamic websites and web applications using PHP, HTML, CSS, JavaScript, and other relevant technologies.
  • Proficient in frontend frameworks and libraries like HTML, CSS, Bootstrap, jquery, ajax.
  • Design and implement both static and dynamic websites catering to client requirements.
  • Create and maintain Content Management Systems (CMS) and Customer Relationship Management Systems (CRM).
  • Utilize problem-solving skills to troubleshoot and resolve issues in existing web applications.
  • Collaborate with cross-functional teams to ensure effective communication and successful project delivery.
  • Keep abreast of industry trends and emerging technologies to continually improve development processes.

Requirements:

  • Bachelor’s degree in Computer Science, Engineering, or relevant field.
  • Proven work experience as a PHP/ CodeIgniter Developer with a strong understanding of frontend and backend development.
  • Expertise in creating static and dynamic websites, along with hands-on experience in CRM development.
  • Strong problem-solving skills with the ability to analyse and resolve complex issues efficiently.
  • In-depth knowledge of PHP frameworks such as CodeIgniter and Laravel, RESTfull APIs.
  • Familiarity with version control systems (e.g., Git) and agile methodologies.
  • Excellent communication skills and the ability to work in a collaborative team environment.
  • Proficiency in MySQL, SQL
  • Should be able to integrate thirdparty APIs

 

Preferred Qualifications:

  • Experience in deploying and managing web applications on different hosting platforms.


Read more
All Indian IT Services LLP
Leena Mishra
Posted by Leena Mishra
Nagpur
1 - 5 yrs
₹2L - ₹7L / yr
skill iconC#
ASP.NET
skill icon.NET
SQL server
Oracle
+2 more

Job Overview: 


We are seeking a skilled and experienced .NET Developer to join our development team. As a .NET Developer, you will be responsible for designing, coding, testing, and implementing software solutions using Microsoft technologies. 


Responsibilities:

  • Collaborate with cross-functional teams to gather and define software requirements. 
  • Design and develop robust, scalable, and high-performance applications using .NET technologies. 
  • Write clean, well-documented, and efficient code following established coding standards.
  • Perform thorough testing of the developed software to ensure the reliability and stability of applications. 
  • Troubleshoot, debug, and resolve software defects and issues in a timely manner. 
  • Stay updated on the latest trends and technologies in .NET development to enhance team knowledge and productivity. 
  • Collaborate with other developers to review code, provide constructive feedback, and ensure code quality. 
  • Participate in code and design reviews to maintain high development standards. 


Requirements: 

  • Bachelor's degree in Computer Science, Information Technology, or related field. 
  • Proven experience of 2-4 years as a .NET Developer or Software Developer. 
  • Strong proficiency in C#, ASP.NET, and other .NET technologies. 
  • Experience with front-end technologies such as HTML, CSS, and JavaScript. 
  • Familiarity with databases (SQL Server, Oracle, or others) and data modeling. 
  • Understanding of software development life cycle (SDLC) and best practices. 
  • Excellent problem-solving and communication skills. 
  • Ability to work both independently and collaboratively in a team environment. 
  • Familiarity with Agile/Scrum methodologies is a plus. 
Read more
AGENCY09
at AGENCY09
2 recruiters
Archita Arekar
Posted by Archita Arekar
Mumbai
1 - 3 yrs
₹2L - ₹5L / yr
Client Servicing
Digital Marketing
Social Media Marketing (SMM)

Experience   2 years of experience of a digital advertising agency 

Joining : Immediate 

Responsibility

You will be part of the Operations team who offer client solutions in an innovative manner 


Primary: 

  • Act as the main point of contact between the agency and client. Should be able to research clients products, services, plans competitors and target markets
  • Meet clients for briefings, pitches and present proposals to clients for approval.
  • Brief agency colleagues and work with them to plan and implement the best digital media solutions for the client.
  • Ensure that projects are completed on time and within budget.
  • Handling financial issues with the client, timely estimation collection.
  • Maintain daily interaction with client and internal teams.
  • Working on several campaigns at once, sometimes under pressure and often to tight deadlines.
  • Review advertising trends, consumer surveys, and other data regarding marketing of goods and services to determine the best way to promote product

A Career Growth Opportunity

  • Ability to pursue education with daily work 
  • Get a chance to work on other lucrative projects of the company

Education: Bachelor's Degree or above in advertising, Marketing or a relevant field

Skills :

  • Enthusiastic, energetic, imaginative, a clear communicator, in person and writing
  • Knowledge and proficient usage of of microsoft office  
  • Able to present ideas 
  • To lead relationships through adding value to brands and driving results for clients
  • Needs to have leadership abilities to lead a team and to show ability to put in smart work and focus on deliverables

Salary :As per Industry Standards 

Location: Open to working both from home and office in Mumbai ( Bandra West )
Read more
Fragma Data Systems
at Fragma Data Systems
8 recruiters
Minakshi Kumari
Posted by Minakshi Kumari
Remote only
1 - 5 yrs
₹10L - ₹15L / yr
SQL
PySpark
Responsible for developing and maintaining applications with PySpark 
• Contribute to the overall design and architecture of the application developed and deployed.
• Performance Tuning wrt to executor sizing and other environmental parameters, code optimization, partitions tuning, etc.
• Interact with business users to understand requirements and troubleshoot issues.
• Implement Projects based on functional specifications.

Must Have Skills:
• Good experience in Pyspark - Including Dataframe core functions and Spark SQL
• Good experience in SQL DBs - Be able to write queries including fair complexity.
• Should have excellent experience in Big Data programming for data transformation and aggregations
• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
• Good customer communication.
• Good Analytical skills
Read more
Start up
Start up
Agency job
via Macrohire by Anamika Premi
Pune
5 - 12 yrs
₹12L - ₹20L / yr
User Experience (UX) Design
skill iconHTML/CSS

Job Profile:

 

We are looking for a Senior UX designer to join the Product Experience team assisting in research, design, and development of an innovative user-need based, engaging, and intuitive online SaaS platform. Work with real customers of the SaaS platform to better the design and advocate for users’ needs.

 

Key Attributes you'd need to possess:

 

  • Problem Solver - Quick on your feet, some problems require creative solutions. Communicating those with peers and clients effectively, for presentations and walk through as well as support on client calls if needed.

  • Team Player- Builds strong partnerships with product & engineering teams, and understands how to handle creative differences between teams and stakeholders to manage consistency at a brand level.

  • User-Driven - Advocate for the user and get them the best experience driven by design. We believe in data, the numbers don’t lie! Using data to back design decisions get you extra points! 

  • Business Acumen- Should be willing to learn and understand complex business challenges, and formulate solutions to solve the problems effectively. Someone who makes intelligent decisions - work effectively, plan better, and formulate solutions that can deliver returns.

 

Typical work week look like:

 

  • Research- Conducting user research, client interviews, and usability testing to understand user needs; studying data patterns that highlight these using prospecting tools for performing Client-need Analysis, track their pain-points to develop a reach-out strategy.

  • Ideation and Brainstorming- Brainstorming and designing new features for our SaaS platform based on research, tech requirements, and feature requests. Lots of white-boarding, paper scribbles, and ideas!

  • Dev Support- Communicating with web developers, including providing input on any needed digital enhancements

  • Manage the Brand Guidelines and Visuals- Designing and managing the information architecture for the marketing website and product, drafting information flows and designing wireframes, mockups and prototypes. Branding and Illustrations for OnlineSales.ai and its marketing website or any events the company will be showcased in.

Our ideal candidate should have:

 

  • 4+ years of work experience in designing digital products or experiences

  • Relevant Degree/Diploma or experience/certification in Product or Experience design

  • Great understanding of user-centric design, responsive design and designing for web

  • Good communication skills

  • Software skills - Adobe CC or similar. Any tool you are comfortable with to design and prototype.

  • Any experience in digital marketing is a plus.

  • Good to have knowledge of CSS, HTML - we work hand in hand with developers

 

 

T

Read more
Rivi
at Rivi
1 recruiter
HR Team
Posted by HR Team
Remote, Bengaluru (Bangalore)
1 - 4 yrs
₹7.2L - ₹12L / yr
skill iconJava
skill iconSpring Boot
skill iconReact.js
skill iconJavascript
skill iconNodeJS (Node.js)
+5 more

As our Full Stack Engineer, you will be developing fast, reliable and scalable web applications while taking responsibility for shipping core backend features.

 

Roles and responsibilities:

  1. Develop smooth, scalable and pixel-perfect web-app products
  2. Architect, optimize and scale complex systems like the database engine and APIs
  3. Follow TDD and write well designed, factored, and tested code
  4. Develop new features and maintain existing code
  5. Manage infrastructure and ensure security of applications
  6. Solve complex product and engineering challenges alongside the core team

 

What we're looking for in you:

  1. 4+ years of experience in Full Stack Development
  2. Extensive programming skills with a proficiency in Java, Spring Boot and Javascript
  3. Have strong fundamentals in systems design and RDBMS and NoSQL databases
  4. Product minded: Strong UI/UX and design sense
  5. Strong understanding of asynchronous request handling and dynamic web page development
  6. Experience working with React.js, Next.js, Node.js, HTML, CSS, Redux, TypeScript
  7. Stellar problem solving and research skills with the ability to design scalable systems
  8. Exposure with AWS/GCP, Docker, Kubernetes and CI/CD Setups
  9. Experience in functional, L& P and security testing

 

Benefits of working with Rivi:

  • Stock Options
  • Flexible work hours
  • More responsibilities and more opportunities
  • The chance to exponentially grow in your career, as Rivi grows
  • Work on real innovation and a futuristic vision
  • Enhance your skill-sets and knowledge
  • Opportunity to learn about many different verticals
  • Feel empowered and change things - We value ideas and suggestions
  • Work in an inclusive culture where transparency, creativity, accountability and ownership is encouraged
Read more
MyClassCampus
at MyClassCampus
1 video
3 recruiters
Kinjal SHAH
Posted by Kinjal SHAH
Ahmedabad
2 - 4 yrs
₹4.3L - ₹5.5L / yr
skill iconLaravel
MVC Framework
Object Oriented Programming (OOPs)
RESTful APIs
SQL
+4 more
- Strong knowledge and experience in PHP using MVC Architecture and OOPS.
- Ability to write APIs including Restful APIs.
- Able to consume 3rd party API's
- Familiarity with SQL (MySQL, POSTGRESQL) and NoSQL(MongoDB) databases designing, query optimization techniques and their declarative query languages.
- Creating database schemas that represent and support business processes.
- User authentication and authorization between multiple systems, servers, and environments.
- Experience in Micro-services development will be an added advantage.
- Composer / NPM / Webpack.
- Laravel forge server deployment and management
- Laravel Dusk Testing
- PHP Unit Testing
- Good command of problem-solving and analytical skills.
- Must be technically strong in logical thinking

Addon Front-End Frameworks knowledge:

- Other Front-end frameworks like as Vue.js (Vue CLI, Vuex, Vue Router, and Nuxt.js).
- Proficiency in JavaScript and TypeScript programming.
- Aware about JavaScript basics and Modern JavaScript (ES6 – ES7 – ES8)
- Understanding of server-side rendering and its benefits and use cases
- Working knowledge of npm or Yarn
- Knowledge of Bootstrap, Framework 7
- Working knowledge of HTML5 code template and CSS3 styling (Sass or Less depending on your technology stack)

Addon Server knowledge will be added advantage:

- Proficient understanding of code versioning tools, such as GitHub, GitLab
- Working knowledge of cloud servers (AWS) related services and server administration like setting up
Apache/Nginx, php-fpm etc.. (Nice to have but not mandatory).
- Experience working with Docker (Nice to have but not mandatory)
- Experience with CI/CD tools and processes(Nice to have but not mandatory)
Read more
A sports-focused digital media agency
A sports-focused digital media agency
Agency job
via Jobdost by Ankitha Vyas
Mumbai
2 - 4 yrs
₹6L - ₹8L / yr
MySQL
MySQL DBA
Stored Procedures
Optimization
Database Design
+7 more

Office Location: Goregaon Mumbai

Position description: 2+ years of experience in database development.

Primary Responsibilities:

  • Understand requirements from front end applications developers
  • Write advanced queries, stored procedures, cursors, functions & triggers
  • Conduct code reviews
  • Work with high-traffic application servers


Required Skills:

Mandatory: Passionate about sports, Problem solving, Team player, Target & Result oriented.

Functional: MSSQL Development - TSQL, Stored Procedures, & Triggers, Advance Queries, Optimization, Indexes, Joins, Database Design, JIRA.

Read more
PixoPal
Pune, Pimpri
2 - 7 yrs
₹1L - ₹3L / yr
Adobe Photoshop
Adobe Photoshop Lightroom
Photo manipulation
skill iconAdobe Illustrator
Expert in Skin Retouching using Adobe photoshop at Pune.
Degree of B Arts or State level Drawing Grade examination must


PixoPal is offering a role for photoshop retoucher to work on international assignments.
Check the contact details on the website.

About PixoPal:

PixoPal is a leading photo retouching-as-a-service platform. PixoPal specializes in retouching images of products, fashion, jewelry, furniture, and real-estate. The platform is designed for consistency and fast turnaround. PixoPal currently provides product photo retouching services to one of the world’s top five apparel brands, a top ten still-life photographer, and several e-commerce retailers and products, real-estate, and headshot photographers.
Read more
Sustainable Solutions
at Sustainable Solutions
1 recruiter
Karishma Singh
Posted by Karishma Singh
Pune
0 - 3 yrs
₹1L - ₹2L / yr
Direct Marketing
Institutional Marketing
Digital Marketing
We are a Training and HR services Organisation and looking for a suitable person to promote various training programs we offer within organisations , students and masses
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos