Cutshort logo
For Employers
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Jobdost's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

SMEST Capital
Sanjana Maity
Posted by Sanjana Maity
Khar Road
0 - 1 yrs
₹240000L - ₹300000L / yr
Sales
Negotiation
Communication Skills
Finance
Organizational skills

*JOB DESCRIPTION: HUMAN RESOURCE EXECUTIVE*

*Company Name: SMEST Capital Pvt. Ltd* .

*Location: Khar West, Mumbai*

*Job Type: Full-time*

*Contract: 1 Year*


*About Us*


SMEST Capital Pvt. Ltd. is a growing financial services company specializing in Corporate Bonds and Government Securities. We focus on providing safe and rewarding investment solutions to clients while building long-term relationships.


SMEST enterprises of Individuals who are obsessed with Finance, Tech & Numbers, aspiring to democratise the debt market in India. SMEST recognizes that the key to a prosperous country is majorly driven by its economic activity. Hence, the company seeks to scale the peak of distinction in the financial ecosystem in India. Therefore, with technology progressing we are also looking to expand our brand reach for which we are looking for a Mumbai based experienced mind to fill in the position as ‘HR Executive’.


*Roles & Respon*ibilities:*


* Utilize various recruitment platforms for sourcing, interviewing, and hiring candidates.Prepare HR documents, such as employment contracts, offer letters, and ne* hire guides.

* Organize and maintain personnel records in compliance with company policies and lega* requirements.

* Regularly update and maintain internal HR databases.Develop and manage training materials and onboarding processes to ensure smooth integration o* new employees.

* Oversee end-to-end recruitment processes, from sourcing to*final selection.

* Manage payroll processing, ensuring accuracy and compliance with*company policies.

* Coordinate travel arrangements and accommodations for management an* senior employees.

* Facilitate effective internal communications*across departments.

* Oversee IT-related issues and support for HR-related technology sy*tems.


*Requirements:*


* Minimum 1 year of experience in H*man Resource Management.

* Proficiency in MS Office Suite (Word, Ex*el, PowerPoint, Outlook).

* Excellent verbal and wr*tten communication skills.

* Strong analytical and problem-solving mindset.Exce*tional presentation skills.

* Self-motivated with * proactive approach to work.

* Excellent organizational skills with the ability to*prioritize tasks effectively.

* Must be able to work from the office.

Read more
Miracle Hub
at Miracle Hub
1 recruiter
Asif Khan
Posted by Asif Khan
Mumbai
1 - 5 yrs
₹12L - ₹18L / yr
Windows Azure
DevOps

Job Title: Data Architect - Azure DevOps

 

Job Location: Mumbai (Andheri East)

 

About the company:
MIRACLE HUB CLIENT,
   is a predictive analytics and artificial intelligence company headquartered in Boston, US with offices across the globe. We build prediction models and algorithms to solve high priority business problems. Working across multiple industries, we have designed and developed breakthrough analytic products and decision-making tools by leveraging predictive analytics, AI, machine learning, and deep domain expertise.

 

Skill-sets Required:

  • Design Enterprise Data Models
  • Azure Data Specialist
  • Security and Risk
  • GDPR and other compliance knowledge
  • Scrum/Agile
     

Job Role:

  • Design and implement effective database solutions and models to store and retrieve company data
  • Examine and identify database structural necessities by evaluating client operations, applications, and programming.
  • Assess database implementation procedures to ensure they comply with internal and external regulations
  • Install and organize information systems to guarantee company functionality.
  • Prepare accurate database design and architecture reports for management and executive teams.

 

Desired Candidate Profile:

 

  • Bachelor’s degree in computer science, computer engineering, or relevant field.
  • A minimum of 3 years’ experience in a similar role.
  • Strong knowledge of database structure systems and data mining.
  • Excellent organizational and analytical abilities.
  • Outstanding problem solver.
  • IMMEDIATE JOINING (A notice period of 1 month is also acceptable)
  • Excellent English communication and presentation skills, both verbal and written
  • Charismatic, competitive and enthusiastic personality with negotiation skills

 

Compensation: NO BAR  .

Read more
Well known manufacture client.
Well known manufacture client.
Agency job
via Kalibre global konnects by Bhumin Patel
Ahmedabad
1 - 3 yrs
₹1.5L - ₹2.5L / yr
Sales
Field Sales
Marketing
Target audience
Manufacturing
 Job Title:- Field Manager (Sales& Marketing)
 Job Location:- Corporate Road, Ahmedabad
 Exp.:- 1yrs to 2yrs
 Working days:- Mon to Sat
 Benefits:- Travel, Food, Petrol Allowance
Job Duties:-
1. Required field sales and marketing manager for aluminum firm.
2. Confident personality.
3. Engineering Education preferred.
4. Experience in aluminum industry preferred but not a requirement.
5. Excellent communication English, Hindi and Gujarati
6. Presentation Skills
7. Lead Generation Skills
8. Street Smart
9. Negotiation Skills
Read more
B2B credit payments platform
B2B credit payments platform
Agency job
via Qrata by Rayal Rajan
Remote only
3 - 8 yrs
₹18L - ₹45L / yr
DevOps
skill iconKubernetes
skill iconDocker
skill iconAmazon Web Services (AWS)
Company info-
True to its name, is on a mission to unlock $100+ billion of trapped working capital in the economy by creating India’s largest marketplace for invoice discounting to solve the day-to-day. problems faced by businesses. Founded by ex-BCG and ISB / IIM alumni, and backed by SAIF Partners, CashFlo helps democratize access to credit in a fair and transparent manner. Awarded Supply Chain Finance solution of the year in 2019, CashFlo creates a win-win ecosystem for Buyers, suppliers
and financiers through its unique platform model. CashFlo shares its parentage with HCS Ltd., a 25 year old, highly reputed financial services company has raised over Rs. 15,000 Crores in the market till date,
for over 200 corporate clients.

Our leadership team consists of ex-BCG, ISB / IIM alumni with a team of industry veterans from financial services serving as the advisory board. We bring to the table deep insights in the SME lending
space, based on 100+ years of combined experience in Financial Services. We are a team of passionate problem solvers, and are looking for like-minded people to join our team.

The challenge
Solve a complex $300+ billion problem at the cutting edge of Fintech innovation, and make a tangible difference to the small business landscape in India.Find innovative solutions for problems in a yet to be discovered market.

Key Responsibilities
As an early team member, you will get a chance to set the foundations of our engineering culture. You will help articulate our engineering
principles and help set the long-term roadmap. Making decisions on the evolution of CashFlo's technical architectureBuilding new features end to end, from talking to customers to writing code.

Our Ideal Candidate Will Have
3+ years of full-time DevOps engineering experience
Hands-on experience working with AWS services
Deep understanding of virtualization and orchestration tools like Docker, ECS
Experience in writing Infrastructure as Code using tools like CDK, Cloud formation, Terragrunt or Terraform
Experience using centralized logging & monitoring tools such as ELK, CloudWatch, DataDog
Built monitoring dashboards using Prometheus, Grafana
Built and maintained code pipelines and CI/CD
Thorough knowledge of SDLC
Been part of teams that have maintained large deployments

About You
Product-minded. You have a sense for great user experience and feel for when something is off. You love understanding customer pain points
and solving for them.
Get a lot done. You enjoy all aspects of building a product and are comfortable moving across the stack when necessary. You problem solve
independently and enjoy figuring stuff out.
High conviction. When you commit to something, you're in all the way. You're opinionated, but you know when to disagree and commit.
Mediocrity is the worst of all possible outcomes.

Whats in it for me
Gain exposure to the Fintech space - one of the largest and fastest growing markets in India and globally
Shape India’s B2B Payments landscape through cutting edge technology innovation
Be directly responsible for driving company’s success
Join a high performance, dynamic and collaborative work environment that throws new challenges on a daily basis
Fast track your career with trainings, mentoring, growth opportunities on both IC and management track
Work-life balance and fun team events
Read more
well-funded women-centric healthtech start-up
well-funded women-centric healthtech start-up
Agency job
via Qrata by Prajakta Kulkarni
Mumbai
5 - 12 yrs
₹25L - ₹38L / yr
Product Marketing
Product Marketer
Mobile App Marketing
Technology Marketing
Growth Hacking
+2 more
  • Accountable for conversion% of visitors at Gynoveda.com
  • Map customer journey, define use cases & service design to drive engagement & purchases
  • Build frictionless online customer experience for website & app
  • Optimize marketing funnels for customer acquisition, retention, video-content  
  • Develop mobile app for menstrual health tracking, online consultation, content marketing
  • Drive marketing automation and integrate multiple online SaaS tools using API, plugins
  • Build unified tech solutions for - 
    • Customers - online sales & support via responsive website and mobile app
    • Employees - process & tools for operations, customer service, supply chain
Read more
Naico Its
at Naico Its
1 recruiter
geethu B
Posted by geethu B
Remote only
8 - 15 yrs
₹10L - ₹16L / yr
skill iconHTML/CSS
skill iconJavascript
skill iconAngular (2+)
skill iconAngularJS (1.x)
ASP.NET
+5 more

Key Requirements:
 Strategic business acumen and understanding of organization strategy and ability to design
information systems to deliver that strategy.
 Excellent communication skills with ability to explain technical concepts to non-technical
audiences. Some experience working with board level stakeholders.
 Team player with experience leading and collaborating cross-team to ensure successful delivery
of solutions.
 Strong conceptual and analytical skills - demonstrating out-of-box problem solving skills.
 Working knowledge of infrastructure including servers, storage, firewalls, load balancers,
routers, etc
 Deep technical knowledge and experience in Web Application Development on Microsoft slack.
 Strong experience in Object Oriented Design and Analysis. Experience working with different
architectural patterns.
 Data modeling skills with experience in building at least one large scale project from scratch.
 Analytical capabilities and hands on experience in preparing Design documents.
 Exposure to Agile development process with ability to multi-task and work under pressure.
 Must have 8 to 10 years of experience in the software industry.
 Must have worked as an Architect / Tech Lead / Team Lead or Project Lead with a team size of 6
or more developers for at least 2 - 3 years.

Responsibilities
 Partner with the organization to understand organization and departmental strategy and agree
information systems solutions to meet needs.
 Investigate information systems that might benefit Naico.
 Lead in designing, specifying and selecting information system solutions, considering
functionality, data, security, integration, infrastructure and performance.
 Develop and maintain a model of Naico’s current and future Application Architecture.

 Develop and maintain a model of Naico’s current and future web architecture and design a
structure that is stable and robust.
 Lead the organization in exploiting technology and use knowledge of IT solutions to drive
organizational change and support business process design.
 Understand and support to software architecture design and support development team in
developing solutions.
 Estimate cost, and prepare business cases for IT solutions, considering infrastructure, licenses,
development and support.
 Work with the Project Managers and Business Analysts to develop high level project schedule
resource plans for implementation projects.
 Supervise Business Analyst in the capture and analysis of requirements.

Educational qualification: Bachelors Degree / Masters in relevant stream.
Experience: 8 - 15 years.
Read more
Eximius Ventures
at Eximius Ventures
1 recruiter
Amrita Saini
Posted by Amrita Saini
Gurugram
1 - 3 yrs
₹8L - ₹15L / yr
skill iconReact Native
Mobile App Development
Job Eligibility:
  • Knowledge in React Native is a must.
  • Should have 1-2 year prior experience in developing App in Android and IOS
  • Should have deployed at least one app in play store and app store having more than 500+ download or having technical competency in similar level
  • Should have eagerness to learn & grow in a fast-paced start-up & its dynamic environment
  • Willing to go beyond and shows high performance

Job Description:
  • Taking care of entire mobile app development (both android and IOS).
  • Build pixel-perfect, responsive UIs across both mobile platforms
  • Leverage native APIs for deep integrations with both platforms
  • Diagnose and fix bugs and performance bottlenecks for performance that feels native
  • Proficient in Object Oriented Programming
Read more
eMandi
at eMandi
1 recruiter
Keshav Agarwal
Posted by Keshav Agarwal
Mumbai
5 - 8 yrs
₹8L - ₹15L / yr
skill iconPHP
skill iconLaravel
MySQL

Responsibilities

  • Server Side Programming Languages: PHP & Laravel (MUST)
  • Framework: Express, Sails.js, Laravel, Node.js .
  • Web Server technologies: Apache, Nginx.
  • Database creation and integration: MySQL (MUST), PostgreSQL, MongoDb.
  • Cloud computing integration e. g., public cloud providers like Amazon Web Services, or private cloud environments.
  • Integration of user-facing elements developed by front-end developers with server side logic.
  • Optimisation of the application for maximum speed and scalability.
  • Implementation of security and data protection.
  • Design and implementation of data storage solutions.
  • Creating database schemas that represent and support business processes.
  • Setup and administration of backups.
  • Management of hosting environment, including database administration and scaling an application to support load changes

 

    Requirements

  • Knowledge of presenting data in different formats
  • Bachelor's degree or equivalent experience in Computer Science with minimum 5+ years of industry experience.
  • Technical depth across multiple languages.
  • Able to meet deadlines.
  • Leadership experience.
  • Strong communications skills.
  • Proficient in writing REST APIs.
Read more
WorkApps Product Solution Pvt. Ltd.
Gauri Dhame
Posted by Gauri Dhame
Pune
5 - 8 yrs
Best in industry
Black-box testing
White-box testing
SQL
Selenium
Manual testing
+2 more

Details

  • Location – Pune
  • Reporting to – Sr. QA Manager
  • Working closely with Product Manager and CTO

 

Educational Background:

  • Engineering Graduate

 

Professional Experience:

  • 5-8 Years of QA experience

 

Tech Skills:

  • Understanding of basic testing principles – Black Box and White Box Testing
  • Document and execute test cases for Black and White box testing.
  • Execute testing tasks and report status and escalating issues as appropriate.
  • Knowledge of testing with multiple browsers – IE, FF and Chrome
  • Document defects and ensure verification of resolutions
  • Work collaboratively with the development team during all stages of projects to provide in process testing results.
  • Knowledge of manual testing
  • Knowledge of JavaScript and VBScript
  • Exposure to automated testing tools like Selenium, WaitiN, JMeter
  • Basic SQL knowledge – writing SELECT queries, INSERT and UPDATE statements etc.

 

Other Skills:

  • Good listener
  • Confident approach
  • Strong problem-solving skill
  • Highly proficient with MS Office
  • Ability to structure processes and lay down the foundation for a department

 

Personality and attitude traits:

  • Passionate about work – We like people who like to work, and want their work to mean something
  • Self-starter and motivator – We do not believe in monitoring or tracking team members
  • Eager and quick to learn – If you are not excited to learn new things, then tech companies are not for you
  • Individual contributor – We are a small team, and everyone has hands on contribution
  • Start-up savvy

 

 

Read more
BlogAddacom
at BlogAddacom
1 recruiter
Harish Krishnan
Posted by Harish Krishnan
Mumbai
1 - 3 yrs
₹3L - ₹6L / yr
Content Marketing
Content Writing
Creative Writing
Because you will get to work with the coolest and the biggest content creators in the country!
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos