Cutshort logo
For Employers
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer

Data Engineer at Product and Service based company · Hyderabad, Ahmedabad · 4 - 8 years · ₹15L - ₹30L / yr · Posted 16 May 2022

Jobdost's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

Timble Technologies
at Timble Technologies
1 recruiter
Shefali Gupta
Posted by Shefali Gupta
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
1 - 3 yrs
₹1L - ₹3L / yr
MS-Excel
Data management
Document review
Operations management

Job Description: Assistant Administrator

Job Summary

We are looking for a detail-oriented and organized Assistant Administrator to join our team. You will provide high-level administrative support, manage daily office operations, and assist the senior management team. Advanced proficiency in office technology is a mandatory requirement for this role.

Key Responsibilities

  • Administrative Support: Manage executive calendars, schedule meetings, and coordinate travel arrangements.
  • Documentation: Prepare, edit, and format reports, presentations, and official correspondence.
  • Office Operations: Oversee office supplies inventory, coordinate with vendors, and ensure the workspace remains organized.
  • Communication: Act as a point of contact for internal/external stakeholders via email and professional communication platforms.
  • Data Management: Maintain and update digital filing systems, ensuring data privacy and efficient retrieval.

Mandatory Computer Skills & Qualifications

Candidates must demonstrate expert-level proficiency in the following areas to be considered:

  • Advanced Microsoft Office Suite: Mastery of Excel (vlookup, pivot tables, formulas), Word (advanced formatting), and PowerPoint.
  • Google Workspace: Full proficiency in Gmail, Drive, Docs, Sheets, and Calendar.
  • Digital Communication: Experience with professional tools such as Slack, Microsoft Teams, or Zoom.
  • Fast & Accurate Typing: Minimum typing speed of 50+ WPM with high accuracy.
  • File Management: Strong understanding of cloud storage (Dropbox, OneDrive) and digital organizational structures.
  • Troubleshooting: Ability to handle basic office tech issues (printer setup, software updates, connectivity).

General Requirements

  • Experience: 1–3 years in an administrative or clerical role.
  • Organization: Excellent time-management skills and the ability to prioritize tasks.
  • Professionalism: High level of discretion and confidentiality.
Read more
App which provides news and other trending content
App which provides news and other trending content
Agency job
via Jobdost by Sathish Kumar
Noida
1 - 8 yrs
Best in industry
skill iconiOS App Development
skill iconObjective C
skill iconSwift
Model-View-View-Model (MVVM)
Core Data
+2 more
IOS Developer
 
Responsibilities:
 • Ability to design and implement and maintain highly complex systems and subsystems 
• Writing well-designed, testable and efficient code 
• Designing and developing advanced applications for the iOS platform 
• Troubleshoot, debug and optimize existing applications Requirements: 
• Bachelor's degree in Computer Science or equivalent 
• Proficient with Objective-C and Swift, Core Data, Core Animation, Networking and 
• Experience with performance and memory tuning with tools 
• Familiarity with push notifications, MVVM 
 CTC: As per market standards 
 Location: Noida 

Company Description: A content consumption and discovery app which provides news and other trending content. It was started in 2013 with the aim of keeping people informed by presenting news in an easily consumable format. It is the highest-rated news app on Google Play Store.
Read more
Talent Pro
Mayank choudhary
Posted by Mayank choudhary
Delhi
10 - 15 yrs
₹80L - ₹110L / yr
Strong Data Architect, Lead Data Engineer, Engineering Manager / Director...
  • Strong Data Architect, Lead Data Engineer, Engineering Manager / Director Profile
  • Mandatory (Experience 1) - Must have 10+ YOE in Data Engineering roles, with at least 2+ years in a Leadership role
  • Mandatory (Experience 2) - Must have 7+ YOE in hands-on Tech development with Java (Highly preferred) or Python, Node.JS, GoLang
  • Mandatory (Experience 3) - Must have recent 4+ YOE with high-growth Product startups, and should have implemented Data Engineering systems from an early stage in the Company
  • Mandatory (Experience 4) - Must have strong experience in large data technologies, tools like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto etc.
  • Mandatory (Experience 5) - Strong expertise in HLD and LLD, to design scalable, maintainable data architectures.
  • Mandatory (Team Management) - Must have managed a team of atleast 5+ Data Engineers (Read Leadership role in CV)
  • Mandatory (Education) - Must be from Tier - 1 Colleges, preferred IIT
  • Mandatory (Company) - B2B Product Companies with High data-traffic

Preferred Companies

MoEngage, Whatfix, Netcore Cloud, Clevertap, Hevo Data, Snowflake, Chargebee, Fractor.ai, Databricks, Dataweave, Wingman, Postman, Zoho, HighRadius, Freshworks, Mindtickle

Read more
Ananta
Shivanjali Pandey
Posted by Shivanjali Pandey
Mumbai
1 - 5 yrs
₹3L - ₹4L / yr
Payroll Management
payroll processing
Operations management
KEKA
Human Resource Management System (HRMS)
+3 more

Job Profile

 

Position: 

HR Executive- Payroll & Operations. 

 

Develop and implement efficient HR strategies to streamline operations, ensure compliance, and drive organizational growth while fostering strong relationships with employees and stakeholders. 

 

Roles and Responsibilities- 

 

       Managing onboarding, offboarding, background checks, document collection, induction programs, exit interviews, clearance              procedures,and final settlements. 

  • Communicating, implementing, and monitoring compliance with HR policies, labor laws, and organizational guidelines. 
  • Overseeing payroll processing, ensuring accuracy in salaries, bonuses, and deductions. 
  • Ensuring compliance with labor laws, tax regulations, and industry standards while preparing and managing HR audits and statutory filings. 
  • Maintaining and updating HR information systems while ensuring accuracy, confidentiality, and proper management of employee records. 
  • Preparing HR metrics and reports, analyzing data to identify trends, and supporting decision-making processes. 
  • Addressing employee queries, supporting grievance handling, and resolving workplace conflicts effectively. 
  • Coordinating with external vendors for payroll, benefits, and training services while collaborating with internal teams like finance and IT. 
  • Streamlining HR processes by identifying opportunities for improvement and implementing automation and technology solutions. 
  • Planning and executing initiatives to improve employee morale, satisfaction, and connection to the organization, including organizing events, conducting engagement surveys, and fostering a positive work culture. 
  • Analyzing employee performance data, generating insights for continuous improvement, ensuring alignment with organizational goals, and supporting appraisal processes.
  • Required skills & Qualifications: 
  • Proficiency in HR policies. 
  • HRIS, payroll, and compliance. 
  • Strong communication, Analytical, and problem-solving skills. 
  • Ability to manage processes, improve operations, and resolve conflicts. 
  • Bachelor’s in HR or related field. 
  • Quick decision-making skills. 
  • A keen eye on details for accuracy. 
  • Strong work ethics. 
  •  KEKA HRMS is must
  • Experience- 3 to 5 years 


Location - Jogeshwari East

Working Days

6 days working

Working Timings

10am-7 pm

Read more
AppLaunchpad
at AppLaunchpad
2 candid answers
1 video
kamal kant
Posted by kamal kant
Remote only
0 - 1 yrs
₹2.5L - ₹3.5L / yr
skill iconJavascript
skill iconjQuery
skill iconVue.js

At AppLaunchpad, we empower app developers, startups, and businesses to showcase their apps through high-quality mockups, templates, and creative assets. We are expanding our tech team and looking for a skilled Web Developer who can help us scale our platform, improve user experience, and bring fresh ideas to life.

Key Responsibilities

  • Design, develop, and maintain AppLaunchpad’s website and related tools
  • Build user-friendly, responsive web pages with strong attention to detail
  • Collaborate with designers and product managers to create seamless UI/UX
  • Implement performance optimizations to ensure fast and reliable user experiences
  • Manage integrations with third-party APIs and payment systems
  • Ensure security, scalability, and SEO best practices are followed

Requirements

  • Proven experience as a Web Developer or Full-Stack Developer
  • Strong skills in HTML, CSS, JavaScript (ES6+), React or Vue.js
  • Experience with backend frameworks (Node.js / Django / PHP)
  • Familiarity with databases (MySQL, MongoDB, PostgreSQL)
  • Knowledge of Git/GitHub workflows
  • Understanding of SEO, performance optimization, and mobile-first development

Nice-to-Have

  • Experience with design/creative platforms or SaaS
  • Familiarity with cloud hosting (AWS, Vercel, Netlify)
  • Previous work on e-commerce or subscription platforms

What We Offer

  • Competitive salary and growth opportunities
  • Work with a creative, fast-moving startup team
  • Flexible working hours and remote-first culture
  • Opportunity to shape the future of app marketing tools


Read more
Flytbase
at Flytbase
3 recruiters
Shilpa Kumari
Posted by Shilpa Kumari
Pune
0 - 4 yrs
₹6L - ₹20L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+1 more

Position: SDE-1 DevSecOps

Location: Pune, India

Experience Required: 0+ Years


We are looking for a DevSecOps engineer to contribute to product development, mentor team members, and devise creative solutions for customer needs. We value effective communication in person, in documentation, and in code. Ideal candidates thrive in small, collaborative teams, love making an impact, and take pride in their work with a product-focused, self-driven approach. If you're passionate about integrating security and deployment seamlessly into the development process, we want you on our team.


About FlytBase


FlytBase is a global leader in enterprise drone software automation. FlytBase platform is enabling drone-in-a-box deployments all across the globe and has the largest network of partners in 50+ countries.


The team comprises young engineers and designers from top-tier universities such as IIT-B, IIT-KGP, University of Maryland, Georgia Tech, COEP, SRM, KIIT and with deep expertise in drone technology, computer science, electronics, aerospace, and robotics.

 

The company is headquartered in Silicon Valley, California, USA, and has R&D offices in Pune, India. Widely recognized as a pioneer in the commercial drone ecosystem, FlytBase continues to win awards globally - FlytBase was the Global Grand Champion at the ‘NTT Data Open Innovation Contest’ held in Tokyo, Japan, and was the recipient of ‘ TiE50 Award’ at TiE Silicon Valley.


Role and Responsibilities:


  • Participate in the creation and maintenance of CI/CD solutions and pipelines.
  • Leverage Linux and shell scripting for automating security and system updates, and design secure architectures using AWS services (VPC, EC2, S3, IAM, EKS/Kubernetes) to enhance application deployment and management.
  • Build and maintain secure Docker containers, manage orchestration using Kubernetes, and automate configuration management with tools like Ansible and Chef, ensuring compliance with security standards.
  • Implement and manage infrastructure using Terraform, aligning with security and compliance requirements, and set up Dynatrace for advanced monitoring, alerting, and visualization of security metrics. Develop Terraform scripts to automate and optimize infrastructure provisioning and management tasks.
  • Utilize Git for secure source code management and integrate continuous security practices into CI/CD pipelines, applying vulnerability scanning and automated security testing tools.
  • Contribute to security assessments, including vulnerability and penetration testing, NIST, CIS AWS, NIS2 etc.
  • Implement and oversee compliance processes for SOC II, ISO27001, and GDPR.
  • Stay updated on cybersecurity trends and best practices, including knowledge of SAST and DAST tools, OWASP Top10.
  • Automate routine tasks and create tools to improve team efficiency and system robustness.
  • Contribute to disaster recovery plans and ensure robust backup systems are in place.
  • Develop and enforce security policies and respond effectively to security incidents.
  • Manage incident response protocols, including on-call rotations and strategic planning.
  • Conduct post-incident reviews to prevent recurrence and refine the system reliability framework.
  • Implementing Service Level Indicators (SLIs) and maintaining Service Level Objectives (SLOs) and Service Level Agreements (SLAs) to ensure high standards of service delivery and reliability.


Best suited for candidates who: (Skills/Experience)


  • Up to 4 years of experience in a related field, with a strong emphasis on learning and execution.
  • Background in IT or computer science.
  • Familiarity with CI/CD tools, cloud platforms (AWS, Azure, or GCP), and programming languages like Python, JavaScript, or Ruby.
  • Solid understanding of network layers and TCP/IP protocols.
  • In-depth understanding of operating systems, networking, and cloud services.
  • Strong problem-solving skills with a 'hacker' mindset.
  • Knowledge of security principles, threat modeling, risk assessment, and vulnerability management is a plus. 
  • Relevant certifications (e.g., CISSP, GWAPT, OSCP) are a plus.


Compensation: 


This role comes with an annual CTC that is market competitive and depends on the quality of your work experience, degree of professionalism, culture fit, and alignment with FlytBase’s long-term business strategy.


Perks:


  • Fast-paced Startup culture
  • Hacker mode environment
  • Enthusiastic and approachable team
  • Professional autonomy
  • Company-wide sense of purpose
  • Flexible work hours
  • Informal dress code


Read more
Aureus Tech Systems
at Aureus Tech Systems
3 recruiters
Naveen Yelleti
Posted by Naveen Yelleti
Kolkata, Hyderabad, Chennai, Bengaluru (Bangalore), Bhubaneswar, Visakhapatnam, Vijayawada, Trichur, Thiruvananthapuram, Mysore, Delhi, Noida, Gurugram, Nagpur
1 - 7 yrs
₹4L - ₹15L / yr
PySpark
Data engineering
Big Data
Hadoop
Spark
+2 more

Skills and requirements

  • Experience analyzing complex and varied data in a commercial or academic setting.
  • Desire to solve new and complex problems every day.
  • Excellent ability to communicate scientific results to both technical and non-technical team members.


Desirable

  • A degree in a numerically focused discipline such as, Maths, Physics, Chemistry, Engineering or Biological Sciences..
  • Hands on experience on Python, Pyspark, SQL
  • Hands on experience on building End to End Data Pipelines.
  • Hands on Experience on Azure Data Factory, Azure Data Bricks, Data Lake - added advantage
  • Hands on Experience in building data pipelines.
  • Experience with Bigdata Tools, Hadoop, Hive, Sqoop, Spark, SparkSQL
  • Experience with SQL or NoSQL databases for the purposes of data retrieval and management.
  • Experience in data warehousing and business intelligence tools, techniques and technology, as well as experience in diving deep on data analysis or technical issues to come up with effective solutions.
  • BS degree in math, statistics, computer science or equivalent technical field.
  • Experience in data mining structured and unstructured data (SQL, ETL, data warehouse, Machine Learning etc.) in a business environment with large-scale, complex data sets.
  • Proven ability to look at solutions in unconventional ways. Sees opportunities to innovate and can lead the way.
  • Willing to learn and work on Data Science, ML, AI.
Read more
Revv
at Revv
1 recruiter
Ankit Kumar
Posted by Ankit Kumar
Gurugram, Delhi, Noida, Ghaziabad, Faridabad
2 - 4 yrs
₹12L - ₹18L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
We are looking for a highly capable Node.js developer to optimize our web-based application performance. You will be collaborating with our front-end application developers, designing back-end components, and integrating data storage and protection solutions.

To ensure success as a Node.js developer, you should possess extensive knowledge of Node.Js based services and experience in a similar role. An accomplished Node.js developer will be someone whose expertise results in the stable, fast, and secure exchange of data between servers and end-users.
Read more
IT Consulting, System Integrator & Software Services Company
IT Consulting, System Integrator & Software Services Company
Agency job
via Jobdost by Ankitha Vyas
Chennai, Bengaluru (Bangalore)
3 - 8 yrs
₹5L - ₹12L / yr
Tableau
SQL
PL/SQL
Responsibilities


In this role, candidates will be responsible for developing Tableau Reports. Should be able to write effective and scalable code. Improve functionality of existing Reports/systems.

·       Design stable, scalable code.

·       Identify potential improvements to the current design/processes.

·       Participate in multiple project discussions as a senior member of the team.

·       Serve as a coach/mentor for junior developers.


Minimum Qualifications

·       3 - 8 Years of experience

·       Excellent written and verbal communication skills

 

Must have skills

·       Meaningful work experience

·       Extensively worked on BI Reporting tool: Tableau for development of reports to fulfill the end user requirements.

·       Experienced in interacting with business users to analyze the business process and requirements and redefining requirements into visualizations and reports.

·       Must have knowledge with the selection of appropriate data visualization strategies (e.g., chart types) for specific use cases. Ability to showcase complete dashboard implementations that demonstrate       visual  standard methodologies (e.g., color themes, visualization layout, interactivity, drill-down capabilities, filtering, etc.).

·       You should be an Independent player and have experience working with senior leaders.

·       Able to explore options and suggest new solutions and visualization techniques to the customer.

·       Experience crafting joins and joins with custom SQL blending data from different data sources using Tableau Desktop.

·       Using sophisticated calculations using Tableau Desktop (Aggregate, Date, Logical, String, Table, LOD Expressions.

·       Working with relational data sources (like Oracle / SQL Server / DB2) and flat files.

·       Optimizing user queries and dashboard performance.

·       Knowledge in SQL, PL/SQL.

·       Knowledge is crafting DB views and materialized views.

·       Excellent verbal and written communication skills and interpersonal skills are required.

·       Excellent documentation and presentation skills; should be able to build business process mapping document; functional solution documents and own the acceptance/signoff process from E2E

·       Ability to make right graph choices, use of data blending feature, Connect to several DB technologies.

·       Must stay up to date on new and coming visualization technologies. 

 

Pref location: Chennai (priority)/ Bengaluru  

Read more
Large corporation providing cloud solutions
Large corporation providing cloud solutions
Agency job
via Anram Solutions Pvt Ltd by Dev Reddy
Hyderabad
3 - 7 yrs
₹4L - ₹15L / yr
skill iconReact Native
skill iconiOS App Development
skill iconAndroid Development
skill iconJavascript
Job Description We are looking for a React Native developer interested in building performant mobile apps on both the iOS and Android platforms. Building a product is a highly collaborative effort, and as such, a strong team player with a commitment to perfection is required. Responsibilities ● Build pixel-perfect, buttery smooth UIs across both mobile platforms. ● Leverage native APIs for deep integrations with both platforms. ● Diagnose and fix bugs and performance bottlenecks for performance that feels native. ● Maintain code and write automated tests to ensure the product is of the highest quality. Skills ● 5+ years as a professional software developer Experience with React and React Native (especially in brownfield applications) ● Experience with at least one native mobile platform (bonus points if you moved to React Native from iOS or Android development) ● Experience with styleguide-driven development ● Firm grasp of the JavaScript (and TypeScript or ClojureScript) language and its nuances, including ES6+ syntax
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos