Cutshort logo
Consulting and Services company logo
Data Engineer
Consulting and Services company
Data Engineer
Consulting and Services company's logo

Data Engineer

at Consulting and Services company

Agency job
5 - 10 yrs
₹5L - ₹30L / yr (ESOP available)
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
skill iconPython
PySpark

Data Engineer 

  

Mandatory Requirements  

  • Experience in AWS Glue 
  • Experience in Apache Parquet  
  • Proficient in AWS S3 and data lake  
  • Knowledge of Snowflake 
  • Understanding of file-based ingestion best practices. 
  • Scripting language - Python & pyspark 

 

CORE RESPONSIBILITIES 

  • Create and manage cloud resources in AWS  
  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies  
  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform  
  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations  
  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data. 
  • Define process improvement opportunities to optimize data collection, insights and displays. 
  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible  
  • Identify and interpret trends and patterns from complex data sets  
  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.  
  • Key participant in regular Scrum ceremonies with the agile teams   
  • Proficient at developing queries, writing reports and presenting findings  
  • Mentor junior members and bring best industry practices  

 

QUALIFICATIONS 

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)  
  • Strong background in math, statistics, computer science, data science or related discipline 
  • Advanced knowledge one of language: Java, Scala, Python, C#  
  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake   
  • Proficient with 
  • Data mining/programming tools (e.g. SAS, SQL, R, Python) 
  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum) 
  • Data visualization (e.g. Tableau, Looker, MicroStrategy) 
  • Comfortable learning about and deploying new technologies and tools.  
  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.  
  • Good written and oral communication skills and ability to present results to non-technical audiences  
  • Knowledge of business intelligence and analytical tools, technologies and techniques. 

 

Familiarity and experience in the following is a plus:  

  • AWS certification 
  • Spark Streaming  
  • Kafka Streaming / Kafka Connect  
  • ELK Stack  
  • Cassandra / MongoDB  
  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools 
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Vithamas Technologies Pvt LTD
at Vithamas Technologies Pvt LTD
2 candid answers
moshin ayaz
Posted by moshin ayaz
Mysore
2 - 4 yrs
₹5L - ₹15L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+3 more

Core Competency:


Professional development experience, working the full stack on large scale B2B, SaaS products. • Expertise with learning new technologies and strong experience with our tech stack AngularJS, JavaScript, Node.js, Go, React.js and Postgres. • Bachelor’sin Computer Scienceorsolid knowledgeof CS fundamentals(OOP, designpatterns, algorithms, etc...) • Experience and adesire towork in a fast-paced environment. • We are a leading cloud-based open platform used by some of the most prestigious companies around • You will get to work with some of the most complex technologies on the market today • You will have an opportunity to work at all levels of the organization.

Read more
Puthur Infotech Pvt Ltd
Bengaluru (Bangalore)
1 - 2 yrs
₹1L - ₹3L / yr
IP PBX
Avaya IP Office
Matrix management
telecom engineer is shoud be skills in telephonic connection ip ipbx, epbx solution , telephonic troubleshooting , networking , cisco , video conferancing , etc.  
Read more
Paytm
at Paytm
41 recruiters
Mohd Sheikh
Posted by Mohd Sheikh
Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Dehradun, Chandigarh
2 - 5 yrs
Best in industry
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Xcode
Model-View-View-Model (MVVM)
+4 more
About the role:
 
Paytm is looking to hire engineers with sound knowledge in iOS application development using swift, objective-c & its frameworks.
 
Requirements:
 
Should be able to design and build advanced app features for the iOS platform
Should be able to collaborate with cross-functional teams to define, design, and ship new features.
Unit-test code for robustness, including edge cases, usability, and general reliability.
Work on bug fixing and improving application performance.
Continuously discover, evaluate, and implement new technologies to maximize development efficiency.
UI development with Interface Builder and Code, including AutoLayout.
 
Skills that will help you succeed in this role:
 
2-5 years of iOS development.
Candidates should have strong experience of Data Structures, algorithm and oops concepts.
Have published one or more iOS apps in the app store
A deep familiarity with Objective-C, Swift and Cocoa Touch
Experience working with iOS frameworks such as Core Data, Core Animation, Core Graphics and Core Text
Experience with third-party libraries and APIs
Working knowledge of the general mobile landscape, architectures, trends, and emerging technologies
Solid understanding of the full mobile development life cycle
Read more
i2TECHS
at i2TECHS
1 recruiter
Dharmendra Parmar
Posted by Dharmendra Parmar
Ahmedabad
1 - 2 yrs
₹3L - ₹5L / yr
skill icon.NET
ASP.NET
skill iconC#

Job roles and responsibilities

Under the supervision of the Director, the .Net Developer designs, modifies, develops, writes, and implements software programming applications and components; supports and/or installs software applications and components; works from written specifications and pre-established guidelines to perform the functions of the job and maintains documentation of process flow.

 

·        Utilize established development tools, guidelines and conventions including but not limited to ASP.NET, SQL Server, HTML, CSS, JavaScript, and C#/VB.NET

·        Design, code and test new Windows and web software applications

·        Enhance existing systems by analyzing business objectives, preparing an action plan and identifying areas for modification and improvement

·         Maintain existing software systems by identifying and correcting software defects

·        Investigate and develop skills in new technologies

·        Create technical specifications and test plans

 

Competencies and Skills Required

·        Requires excellent analytical, problem solving, and good communications skills

·        Must be able to work effectively with business stakeholders

·        Strong passion for delivering technical solutions to business problems

·        Understanding and mindset of Agile software delivery (Ability to adapt to continually changing priorities)

·        Team player who understands the importance of teamwork and collaboration

·        Passion for delivering new approaches and challenging the ‘status-quo’

·        Hungry to learn and always in search of continuous improvement

 

Read more
B2B2C Loyalty Platform of one of India's Largest retailer
B2B2C Loyalty Platform of one of India's Largest retailer
Agency job
via Merito by Gaurav Bhosle
Bengaluru (Bangalore)
8 - 13 yrs
₹80L - ₹99L / yr
Technical Architecture
Solution architecture
Information architecture
Java Architecture for XML Binding (JAXBJava Architecture for XML Binding...
Enterprise architecture
+8 more

Hello

Job Description

Our client is a B2B2C tech firm backed by India’s largest retailer and tech venture capitalist founded by founders - IITB Graduates who are experienced in retail, ecommerce and fintech
 
It aims to become one app to manage all your brands loyalty points, cashback and coupons. It will have additional content and discovery layer for customers and brands for further engagement and commerce.
 
The company currently powers closed-loop loyalty programs for all different brands under its parent retail group. Currently, it has 20Mn+ registered customers and 3Mn MAU across 8 brands. Its vision is to be at the center of D2C Brands and the consumer consumption ecosystem
 
Role description:
 
We are looking for a competent CTO (Chief Technology Officer) who will be our first technology go-to expert and play an integral role in setting the company’s strategic direction, development, and future growth. In this position, you will oversee our overall technology development and technology utilization plan to manage all information technology resources of our company.
 
Key Responsibilities
 
● CTO will be leading, building, and operating exciting products with a passionate team.
 
● We are looking for someone who has developed and deployed software with a strong focus on end-user experience. We are seeking someone with a proven track record of shipping web scalable products.
 
● The ideal candidate will have a track record of building and delivering cloud solutions with delightful consumer experiences, combined with ease of implementation/reliability.
 
● Experience with massively scalable distributed compute product architectures.
 
● Experience with micro services-oriented architectures, Experience with scaling Big Data infrastructure.
 
● Experience delivering platform technology and creating an ecosystem of applications and services across multiple verticals and solution offerings
 
● Experience successfully scaling technology infrastructure to support rapid customer /data
 
growth.
 
● Experience with fast-paced, rapidly-iterating, design-forward, product-focused companies.
 
● "Roll-up-your-sleeves" entrepreneurial, start-up attitude, team player with record of leading and mentoring employees
 
 
Why is this a great opportunity for the right candidate
 
● Experienced founding team
 
● Backed by India’s biggest retailer which gives an edge over working with different D2C and traditional brands ecosystem which is necessary to win in this market
 
● The existing app customer base of 20Mn registered and 4Mn MAU + which gives us ahead
 
start and starting customer base
 
● Right to win - The founding team knows the business & its secrets inside out. We are
 
starting with a significant head start and a precise plan of action
 
● Barriers to entry - This is a specialized play with natural barriers to entry, allowing for
 
significant value creation for all equity holders
 
● Exposure to all aspects of company building - exposure to investors, fund-raising, decision
 
making, building the team & culture
 
● All of the above perks of joining a high potential company very early, along with a
 
competitive market salary.
 
Founders Profile
 
One of the co-founders is a graduate of IIT Bombay. In his last few roles, he was a product and business head at leading fintech startups ZestMoney, MoneyTap - Freo and Paytm- He thinks about Product, Business Models and Company Building, here
 
Another co-founder is a graduate of Bombay He spent his first 5 years at EverStone, across Singapore & India to manage 10-15 PE businesses. He has done various large scale growth initiatives in the retail business. He thinks about Product, Data and Tech here.
 
Let’s Chat!
 
We are now building our leadership team and would love to chat with you This is a great time to join the rocketship and participate in the upside -
 
● You will have super interesting & challenging problems to solve
 
● In a super fast-paced environment that will challenge you
 
● With enough resources to play offense
 
● You will be building industry-first product
 
● You will be the core founding team member

Requirements

Candidate Experience: Desired skills
 
● He/she should have prior work experience of 6-12 years on large-scale SaaS/Mobile app products and can rapidly familiarize yourself with complex products
 
● Strong track record of being able to develop and set release plans, track deadlines, deliverables, resource allocations, issues/risks and create mitigation strategies as needed to deliver a quality product on time
 
● Strong technical and architecture skills in wide areas of platform engineering with proven ability to dive deep in any area as needed.
 
 
● Extensive experience with eCommerce platforms, cloud systems, payment solutions, digital marketing technology, automation, and multi-device development is required; AWS experience is a strong plus
 
● Experience managing small teams and remote teams is a strong plus
 
● Competent in driving a culture of continuous learning to improve technology and remove roadblocks that hold the team back.
 

Benefits

Attractive fixed salary + ESOPs
Read more
Curry Tree
at Curry Tree
1 recruiter
Rohan As
Posted by Rohan As
Mumbai, Navi Mumbai
2 - 4 yrs
₹1L - ₹6L / yr
FMCG
Field Sales
Direct sales
Sales
People skills
+2 more
21Grams Food Creations Private Limited is a food company. Under it, we have the brand Curry Tree, a range of ready-to-cook curry pastes. 21Grams is the weight of the soul, which in effect would make us the soul food creation company. Like our name suggests, with Curry Tree, our aim is to help people recreate curries with zero fuss and 100% efficiency.

The main objective is to increase the presence of our products in Category A stores across Mumbai.
There will be 2 people in your team, to help you achieve this.
You will have to lead this team to:
1. identify the right stores for our products to be placed
2. Visit the store and explain our product to storekeepers
3. Book orders for the products
4. Work on stock updation data from stores
Read more
Aryston Web Solution
at Aryston Web Solution
2 recruiters
raheel ahmed
Posted by raheel ahmed
Kolkata
1 - 2 yrs
₹1.2L - ₹2L / yr
Web
web consultant
B2B Marketing
bpo
Sales
+3 more
Looking for smart tele caller for Website Sales Job
Website sales for US/ UK/ Canada/ Europe based businesses
Night shift 8pm - 5 am
Morning Shift 10am - 7pm
Huge incentive on achieving targetInternational B2B sales
Experience-0.6 to 1 yrs prior experience in webste process or any international voice process experience.
Read more
GetMyUni
at GetMyUni
3 recruiters
Ranjith Kumar
Posted by Ranjith Kumar
Remote only
0 - 1 yrs
₹1.5L - ₹2.5L / yr
Search Engine Optimization (SEO)
Content Marketing
Content Writing
Keyword Research
About GetMyUni

GetMyUni is a Times Internet-backed ed-tech start-up disrupting the college admissions space in India. We are a social college search platform that empowers students with making the most important decision of their life - choosing a college, by providing them access to exhaustive college information, data points, the student is given ratings, reviews, forums, and a student connect platform.

For colleges, we are a one-stop student recruitment solution equipping them with

High-Quality Student Leads

Highly Cost Optimal Marketing and Communication solutions

Job Responsibilities :

- Ideate and create compelling content for web and social media platforms

- Attention to detail in implementing the best SEO practices

- Knowledge of SEO/ User-friendly content for a website

- Collaborating with other departments to create narrative and informative content
 
- An opportunist for finding and developing new ideas for web content by doing keyword research and competitor analysis.

Skills Required :

- Proficiency in English (written and verbal).

- Proficient in MS Office (Excel, Word, and Powerpoint).

- Excellent interpersonal skills.

Career Roadmap with us:

 - First Six Months [Concentration in Core Content]

- Learning to design content that both humans and search engines will love
- Understanding how to cater to content based on user behavior using advanced tools such as:

- Google Webmaster and Analytics

- Google Trends

- Get professionally trained in editing and proofreading web content

- Get creative with video and pictorial representation of web content

- Next One Year [Concentration in Content + SEO]

- Become fluent in analysis - Competitors and Keywords

- Get hands-on experience with Advanced SEO Tools

- SEMRush

- Ahref

- Screaming Frog

- Crazy Egg

- Expertise in technical and Off-page SEO

- Next Six Months [Concentration on Product Development]

- Developing products or sub-products from the ideation stage to the implementation stage

- Creating the entire structure of a web portal and prototyping

- Setting up roadmaps and strategies for product performance

- Effective inter-team communication and coordination

- Use product management tools
Read more
company logo
Agency job
via Devrabbit It Solutions Pvt LTD by Shirisha Avusula
Hyderabad
2 - 4 yrs
₹5L - ₹7L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux

JD:
Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model

Thorough understanding of React.js and its core principles

Experience with popular React.js workflows (such as Flux or Redux)

Familiarity with newer specifications of EcmaScript

Knowledge of isomorphic React is a plus

Familiarity with RESTful APIs

Knowledge of modern authorization mechanisms, such as JSON Web Token

Experience with common front-end development tools such as Babel, Webpack, NPM, etc.

Ability to understand business requirements and translate them into technical requirements

A knack for benchmarking and optimization

Familiarity with code versioning tools such as Git

Read more
Paypermint Pvt. Ltd
at Paypermint Pvt. Ltd
2 recruiters
Hira Singh
Posted by Hira Singh
Kolkata
3 - 7 yrs
₹2L - ₹10L / yr
Virtualization
skill iconPython
skill iconC++
Visual C++
Perl
+3 more
• Proficient in C++ • 4+ years of industry experience in engineering required • Willing to learn and work on any programming language/stack/framework • Exposure to architectural patterns of large, scalable web applications and services. • Experience with cloud computing best practices. • Experience in working with Agile Methodologies • A degree in Computer Science is preferred
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos