Cutshort logo
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Product and Service based company's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Bengaluru (Bangalore)
3 - 5 yrs
₹20L - ₹30L / yr
Google Cloud Platform (GCP)
Strong Senior Unity Developer Profile Mandatory (Experience 1) - Must...
  • Strong Senior Unity Developer Profile
  • Mandatory (Experience 1) - Must have a minimum 2+ years of experience in game/application development using Unity.
  • Mandatory (Experience 2) - Must have strong experience in backend development using C#
  • Mandatory (Experience 3) - Must have strong experience in multiplayer game development with Unity, preferably using Photon Networking (PUN) or Photon Fusion.
  • Mandatory (Company) - B2C Product Companies

Preferred

  • Preferred (Education) - B.E / B.Tech


Read more
An American digital consulting company
An American digital consulting company
Agency job
via Jobdost by Sathish Kumar
Bengaluru (Bangalore), Delhi
4 - 14 yrs
₹5L - ₹25L / yr
Adobe Experience Manager (AEM)
skill iconJenkins
skill iconAmazon Web Services (AWS)
Load balancing
skill iconGit
+6 more

Job Description 

The future is infinitely wide and begging to be reimagined and we are looking for people who have the courage to make their dent in what has always been. If you have an optimism that says there is no limit to what we can achieve in a time inviting those with vision to shake things up, then we should talk. Our work is fueled by connected thinking, challenging boundaries, and the power of digital redefining a connected world. Our people thrive because of the belief that it’s both our privilege and responsibility to usher our clients and the world into what is next. We’re seeking those who question the status quo and want to reimagine the way the world works while realizing a smarter way for business to help – all in service of improving the daily lives of people, the world, your career. Next_reimagined. 

Your Impact: 

  • Drive the design, planning, and implementation of multifaceted applications, giving you breadth and depth of knowledge across the entire project lifecycle. 
  • Combine your technical expertise and problem-solving passion to work closely with clients, turning complex ideas into end-to-end solutions that transform our clients’ business. 
  • Constantly innovate and evaluate emerging technologies and methods to provide scalable and elegant solutions that help clients achieve their business goals. 

Qualifications 

  • Strong hand on experience of Components, Templates, Taxonomy, metadata management, Forward and Reverse Replication, Workflows, Content Publishing and unpublishing, Tagging, Deployment(Maven) and Content migration/ planning. 
  • Strong Physical Architecture concepts (Infrastructure) including but not limited to Load Balancers(ELB), Apache set up, CDN, Disaster Recovery, recommending capacity of AEM publish and author instances. 
  • Taking a lead in recommending the solution considering quality properties of the system like Search Engine Optimization (SEO), Accessibility (A, AA, AAA), Monitoring (Squid, Nagios, Zabbix, Ganglia, App Dynamics, New Relic etc.), Scalability, Security, Performance and Responsive architecture 
  • Has implemented Quality Processes for projects like Continuous Integration (Bamboo/Jenkins/Git/BitBucket/Cloud Manager), SonarQube, Code reviews (Manual and Automated), code Formatters, Automation testing etc. 
  • Good to have Mobile App development and technologies, Digital Asset Management products, Adobe Scene 7(Adobe Dynamic Media), integration with eCommerce products like Hybris, Magento, ElasticPath and micro-services based architecture experience. 
  • Strong knowledge of Cloud native approaches and platforms including AWS, Azure or GCP 
  • Experience with SaaS based implementation of AEM as Cloud Service and AEM SDK (preferred).  
  • Good knowledge with Adobe I/O Runtime and Adobe I/O Events.  
  • Good experience with frontend technologies like Bootstrap, Backbone.js, ReactJS, Handlebars, Grunt, Angular, CSS3, HTML 5 and jQuery. 
  • Knowledge of templating with JSP, HTL, and integration with MVC FE frameworks. 
  • Mastery of all relevant “core Java technologies” with Java 8/11 that are used in most Java-centric CMS/WCM platforms, including but not limited to XML, XSL, XSLT, XSD, server-side programming models, and other related presentation, middle-tier & persistence frameworks 

Set Yourself Apart With: 

  • Develop Digital Consumer experiences based on Adobe marketing cloud products including AEM. 
  • Define solution architecture for global customer engagement and global web content management platforms, integrating a full collage of supporting technologies including AEM, Search, Adobe Social, Adobe Analytics, Adobe Communities, Adobe Target, Adobe Campaign Standard, Adobe Launch and others 
  • Develop powerful features such as multi-site and multi-channel delivery, personalization/targeting, content aggregation & syndication, multi-lingual support, automated workflow management, social media etc. 
  • Diagnose and solve technical problems related to AEM implementation. 
  • Interact with clients to create end-to-end specifications and solution architecture for content & collaboration solutions. 
  • Provide inputs and direction to senior developers on the team for design and implementation. 
  • Define implementation processes, quality gates and standards for design and development. 
  • Define best practices to manage performance, security and scalability of the Digital Platforms 
  • Lead teams of 20+ people through all phases of Development. Agile development methodology is a plus 
  • Lead and Involve in Planning and estimations of Adobe projects, Lead all tracks of the project from Frontend, backend, QA and Project Management 

Additional Information 

  • Gender-Neutral Policy 
  • 18 paid holidays throughout the year for NCR/BLR (22 For Mumbai) 
  • Generous parental leave and new parent transition program 
  • Flexible work arrangements 
  • Employee Assistance Programs to help you in wellness and well being   
Read more
Series A Funded product Startup
Agency job
via Qrata by Blessy Fernandes
Bengaluru (Bangalore)
3 - 7 yrs
₹8L - ₹10L / yr
Recovery

RESPONSIBILITIES

● Responsible for communicating with customers from a collections stand-point

● Omni channel communication such as Email, SMS, Tele Calling etc.

● Contact clients and discuss their overdue payments in a friendly manner, and proactively propose solutions based on defined SOPs

● Monitor accounts on a daily basis

● Identify outstanding account receivables

● Collaborating on debt collection efforts with Finance, Sales, and the Legal team.

● Investigate historical data for debts and bills

● Developing debt collection strategies and plans

● Take actions in order to encourage timely payments

● Process payments and refunds

● Resolve billing issues ● Ensure compliance to all federal and local regulations for collection process

● Update account status records


REQUIREMENTS

● Bachelor’s Degree in Finance, Business or related field

● 3-6 years of relevant experience

● Experience working in the collections team for consumer credit products such as Credit Card, Personal Loan, Education Loan, 2W and 4W, Home Loan, etc.

● Excellent knowledge of various collection techniques

● Experience in developing and enacting debt recovery plans and strategies to prevent losses

● Knowledge of MS Office, Data Interpretation, databases, and alternate mode of collections

● Excellent communication and interpersonal skills

● Demonstrated experience of being empathetic with customers

● Problem-solving and critical-thinking skill

Read more
Colabx
Prithvi Raj
Posted by Prithvi Raj
Remote only
3 - 4 yrs
₹12L - ₹15L / yr
skill iconPython
skill iconReact.js
skill iconPostgreSQL
skill iconJava
skill iconJavascript
+8 more

Join the Team! Full Stack Developer | 3-4 yrs experience | Remote


Do you want first-hand experience in building a startup with a small and growing team? Do you think data and tech can be a game changer?


Welcome to Co.labx: Co.labx is a tech-enabled, leadership consulting firm. At Co.labx, we are challenging the status quo & helping organisations become a force for good. We are a gender-neutral company, work remotely, partner on challenging projects with our clients, and strive to create a balance between people, planet, & profit. We now wish to enhance the role that technology plays in our work. And we have identified some exciting problem statements to push our boundaries in the next 1 year.


About the Role: At Co.labx, we’re proud to build products that accelerate the growth of organisations. To this end, we are looking to onboard a full-stack developer with previous experience working with early-stage startups. We’re looking for a candidate with 3-4 years of experience building, testing, and deploying web or mobile based applications. This individual would possess a strong product mindset, be user-centric, and be willing to experiment and build tools that enable teams to thrive.


Competencies

3-4 years of experience in the software development sector (service / product)

Experience with backend development using Ruby on Rails, Python Django, Java Spring or any other server side framework

Experience with Javascript, CSS and HTML and some frontend frameworks like React.js, Angular.js or equivalent

Experience working with relational databases (eg. MySQL or PostgreSQL)

Familiarity with RES APIs and developing endpoints in a RESTful manner

Experience writing industry-grade, well-tested code for a web-based product or service

Ability to work with uncertainty and rapidly adapting to changes

Strong leadership skills and ability to collaborate with multiple stakeholders to see a product to completion

Excellent communication skills

Expectations

Help plan and develop new software products for the organisation

Write clean, maintainable and scalable code that is production ready and well-tested

Gather requirements and understand need of new products from various teams

Use basic analytics tools and techniques to understand user behaviour and suggest changes to existing products (or enable other team members to do so)

Our pay scale for this role is between 12-15 lacs


Still here? Great, these are the next steps & an overview of the selection process:

Reach out: We love talking about our work, so drop us an email if you want to know more. And if this opportunity excites you, apply with your resume.


Showcase your work: We will share 2 short pre-works with you. We love original, well thought out work. Insider Tip - Work speaks louder than words!


Interview & Selection


If interested, reach out right away and we’re excited to get to know you!

Read more
upGrad
at upGrad
1 video
19 recruiters
Yogesh Pati
Posted by Yogesh Pati
Hyderabad
0 - 5 yrs
₹3L - ₹6L / yr
Communication Skills
MS-Office
Sales presentations
Inside Sales
Sales management
  • The ideal candidate should be a creative problem solver at heart who thrives in a team environment.
  • Your role will start with contacting potential learners to set up virtual meetings, counsel the learners and sell the course of Upgrad.
Read more
Esseplore
at Esseplore
1 recruiter
Ash Win
Posted by Ash Win
Mumbai
2 - 15 yrs
₹5L - ₹25L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
What excites you about this role: • You are passionate about developing simple, elegant websites to complex websites that handle custom functionality. • You are excited about existing/future innovative projects which include edge computing, mobile/web/client applications, cloud, machine learning, AI, and analytics • You enjoy working directly with customers across the globe including USA, Canada, UK & Australia. What excites us about you: • You are skilled with web front end technologies including experience with Ruby on Rails, JavaScript, HTML, and CSS OR mobile app technologies. • You possess demonstrated experience in responsive web development (HTML5 CSS3, JavaScript) • Experience developing highly interactive applications • A firm grasp of object oriented analysis and design • Passion for writing great, simple, clean, efficient code • Good knowledge of relational databases • Working knowledge of NoSQL databases • You are experienced in Linux OS Environments like Ubuntu, Centos, RHEL • You have previous experience in working & deploying in AWS environment • You have a basic understanding of the important AWS Services like EC2, Lambda, Dynamo DB etc • You have experience with high traffic, multi-tier web applications / SaaS web applications • You have experience developing applications based on wireframe designs • You are good at fixing and applying security measures • You are responsible for meeting expectations and deliverables on time and in high quality • You will effectively develop in a clean, well-structured, easily maintainable format • You will demonstrate creative, technical and analytical skills • You have an interest in keeping up to date with the latest web technologies • You possess the confidence to work autonomously within a small team environment • You are able to manage multiple tasks/priorities with tight deadlines • You have an ability to clearly communicate technical jargon in plain language, both verbally and in writing We take care of our own: • Best in class packages • Paid holidays and flexible paid time away • Casual dress code and flexible working environment • Medical Insurance coverage of 4lakhs per family member
Read more
A top MNC in Pune.
A top MNC in Pune.
Agency job
via Jobdost by Riya Roy
Pune
3 - 8 yrs
₹7L - ₹15L / yr
ServiceNow
"Service Now"
ITSM
skill iconJavascript
skill iconHTML/CSS
+3 more

Key aspects of this role: 

  • Maintain, update, and enhance ITSM environment including Incident, Request,  Problem, Change and Knowledge Management, Service Catalog, Service Portals,  SLAs, Discovery, and Integrations 
  • Participate in the implementation and configuration of other ServiceNow products outside of ITSM to increase the adoption of the ServiceNow platform. • Responsible for performing daily administration, issue resolution, and  troubleshooting of the ServiceNow platform. Monitor health, usage, and overall compliance of ServiceNow and its applications.

 

To be the right fit, you will need: 

  • Minimum of 2 years of demonstrated experience in ServiceNow development and  configuration.  
  • Proficient in developing, integrating and maintaining applications using ServiceNow Platform technology and tools.
  • Understanding of and experience working with IT Service Management processes (Incident, Problem, Change, Release, SLM, Service Catalog), PPM/ITBM• Understanding of IT and business requirements with ability to develop, test, deploy improvements, and update Manage and administer lists, filters, forms, platform  interfaces (to other data sources) and the data within tables, import sets and the  CMDB. 
  • Preferably certified in ServiceNow 
Read more
MMF
at MMF
1 recruiter
Muskan Sharma
Posted by Muskan Sharma
Indore
0 - 3 yrs
₹1.2L - ₹1.8L / yr
Front office
Receptionist
Customer Service
Customer Support
Office administration

Requirements:-

 

  • Excellent organizational skills.
  • Customer service attitude.
  • Professional attitude and appearance.
  • Solid written and verbal communication skills.
  • Proven work experience as a Receptionist, Front Office Representative or similar role.
  • Direct visitors to the appropriate person and office.
  • Answer, screen and forward incoming phone calls.
  • Provide basic and accurate information in-person and via phone/email.
  • Maintain office security by following safety procedures and controlling access via the reception desk.
Read more
outgrowing client
outgrowing client
Agency job
via Dunamis by Rama krishna
Remote, Detroit, USA
3 - 7 yrs
₹3L - ₹8L / yr
Marketing
Project Management
MySQL
must be good marketer,
speaker
Hands on experience
Read more
Cooptech Management Pte Ltd
Bengaluru (Bangalore)
3 - 5 yrs
₹4L - ₹8L / yr
skill iconJava
skill iconC++
Data Structures
Algorithms
skill iconScala
+3 more
COOPTECH MANAGEMENT PTE. LTD. (the "Company") is a Exempt Private Company Limited by Shares, incorporated on 31 July 2012 in Singapore. The address of the Company's registered office is at the BEACH CENTRE building. The Company's principal activity is development of software and programming activities n.e.c. with business and management consultancy services (general) as the secondary activity. An ideal candidate will operate at all levels, diving deep into the details while providing strategic inputs for the product in a fast paced environment. our Sr. SDEs don’t just define the technical approach, but also have a seat at the table to help make the right product decisions. As a software developer you will be working with business partners, testers UI/UX designers to design, implement, test, launch, document, and maintain complex software applications, tools, and systems. You will have significant influence on our overall strategy by helping define these product features, drive the system architecture, and spearhead the best practices that enable a quality product. You will learn a variety of cutting-edge technologies and mobile development processes, and develop well-rounded skills on technology, leadership, and effective project management. You will also mentor junior software development engineers. Not only do we deliver high-impact customer facing features, we also focus on learning, sharing, innovating and having fun at work Responsibilities ● Unit-testing code for robustness, including edge cases, usability, and general reliability ● Bug fixing and improving application performance ● Collaborate with cross-functional teams to define, design, and ship new features ● Work with outside data sources and APIs ● Unit-test code for robustness, including edge cases, usability, and general reliability ● Work on bug fixing and improving application performance ● Continuously discover, evaluate, and implement new technologies to maximize development efficiency ● Develop and implement new software programs ● Maintain and improve the performance of existing software ● Clearly and regularly communicate with management ● Provide technical support to colleagues in headquarter Requirements ● BS/MS degree in Computer Science, Engineering or a related subject ● Good social, verbal, and communication skills ● Ability to manage multiple projects and deadlines at once ● Keen eye for design and ideas into development ● 2-3 years of Android App Development experience (4.0 and higher) ● Excellent communication skills with the ability to effectively communicate with both technical and non-technical team members ● Experience with providing Technical Leadership on Full Life-Cycle Development supporting Mission Critical apps ● Proven software development experience and Android skills development ● Proven working experience in Android app development and ● Have published at least one original Android app ● Experience with Android SDK ● Experience with third-party libraries and APIs ● Working knowledge of the general mobile landscape, architectures, trends, and emerging technologies ● Solid understanding of the full mobile development life cycle.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos