Cutshort logo
Product and Service based company logo
Data Engineer
Product and Service based company
Data Engineer
Jobdost's logo

Data Engineer

at Product and Service based company

Agency job
4 - 8 yrs
₹15L - ₹30L / yr
Hyderabad, Ahmedabad
Skills
skill iconAmazon Web Services (AWS)
Apache
Snow flake schema
skill iconPython
Spark
Apache Hive
skill iconPostgreSQL
Cassandra
ETL
skill iconJava
skill iconScala
skill iconC#
HDFS
yarn
CI/CD
skill iconJenkins
JIRA
Apache Kafka

Job Description

 

Mandatory Requirements 

  • Experience in AWS Glue

  • Experience in Apache Parquet 

  • Proficient in AWS S3 and data lake 

  • Knowledge of Snowflake

  • Understanding of file-based ingestion best practices.

  • Scripting language - Python & pyspark

CORE RESPONSIBILITIES

  • Create and manage cloud resources in AWS 

  • Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

  • Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

  • Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

  • Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

  • Define process improvement opportunities to optimize data collection, insights and displays.

  • Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

  • Identify and interpret trends and patterns from complex data sets 

  • Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

  • Key participant in regular Scrum ceremonies with the agile teams  

  • Proficient at developing queries, writing reports and presenting findings 

  • Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

  • 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

  • Strong background in math, statistics, computer science, data science or related discipline

  • Advanced knowledge one of language: Java, Scala, Python, C# 

  • Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

  • Proficient with

  • Data mining/programming tools (e.g. SAS, SQL, R, Python)

  • Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

  • Data visualization (e.g. Tableau, Looker, MicroStrategy)

  • Comfortable learning about and deploying new technologies and tools. 

  • Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

  • Good written and oral communication skills and ability to present results to non-technical audiences 

  • Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

  • AWS certification

  • Spark Streaming 

  • Kafka Streaming / Kafka Connect 

  • ELK Stack 

  • Cassandra / MongoDB 

  • CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Technology Industry
Technology Industry
Agency job
via Peak Hire Solutions by Dharati Thakkar
Bengaluru (Bangalore)
6 - 9 yrs
₹30L - ₹48L / yr
skill iconPython
skill iconReact.js
skill iconNodeJS (Node.js)
TypeScript
ReAct (Reason + Act)
+13 more

Review Criteria:

  • Strong Software Engineer fullstack profile using NodeJS / Python and React
  • 6+ YOE in Software Development using Python OR NodeJS (For backend) & React (For frontend)
  • Must have strong experience in working on Typescript
  • Must have experience in message-based systems like Kafka, RabbitMq, Redis
  • Databases - PostgreSQL & NoSQL databases like MongoDB
  • Product Companies Only
  • Tier 1 Engineering Institutes (IIT, NIT, BITS, IIIT, DTU or equivalent)

 

Preferred:

  • Experience in Fin-Tech, Payment, POS and Retail products is highly preferred
  • Experience in mentoring, coaching the team.


Role & Responsibilities:

We are currently seeking a Senior Engineer to join our Financial Services team, contributing to the design and development of scalable system.

 

The Ideal Candidate Will Be Able To-

  • Take ownership of delivering performant, scalable and high-quality cloud-based software, both frontend and backend side.
  • Mentor team members to develop in line with product requirements.
  • Collaborate with Senior Architect for design and technology choices for product development roadmap.
  • Do code reviews.


Ideal Candidate:

  • Thorough knowledge of developing cloud-based software including backend APIs and react based frontend.
  • Thorough knowledge of scalable design patterns and message-based systems such as Kafka, RabbitMq, Redis, MongoDB, ORM, SQL etc.
  • Experience with AWS services such as S3, IAM, Lambda etc.
  • Expert level coding skills in Python FastAPI/Django, NodeJs, TypeScript, ReactJs.
  • Eye for user responsive designs on the frontend.


Perks, Benefits and Work Culture:

  • We prioritize people above all else. While we're recognized for our innovative technology solutions, it's our people who drive our success. That’s why we offer a comprehensive and competitive benefits package designed to support your well-being and growth:
  • Medical Insurance with coverage up to INR 8,00,000 for the employee and their family
Read more
IT Clients
IT Clients
Agency job
via kaldan soft by sathya priya
Bengaluru (Bangalore)
7 - 14 yrs
₹10L - ₹25L / yr
skill iconC++
golang
skill iconRust
Microsoft Windows
Linux/Unix

Job Title: Cybersecurity Agent Developer

Location: Bengaluru, India

Experience: 7+ Years

Employment Type: Full-time


About the Role:

We are seeking a highly skilled Cybersecurity Agent Developer with deep expertise in C/C++ and Golang or Rust to build and optimize high-performance security agents for Windows, Linux, and macOS platforms. This role requires a strong background in low-level system programming, performance tuning, and security-centric design to ensure effective monitoring, threat detection, and system protection across diverse environments.


Key Responsibilities:

  • Design, develop, and maintain cross-platform endpoint security agents.
  • Optimize agent performance to ensure minimal system overhead and real-time responsiveness.
  • Implement system-level hooks and monitoring components including:
  • Process monitoring
  • File system and network activity tracking
  • System telemetry collection
  • Work with kernel-level APIs and frameworks, such as:
  • ETW, WFP, WMI, MiniFilter (Windows)
  • eBPF, auditd, fanotify, netfilter (Linux)
  • EndpointSecurity framework, XPC, System Extensions (macOS)
  • Build robust, secure inter-process communication (IPC) and data serialization mechanisms.
  • Integrate agents with cloud-based security platforms via REST APIs, gRPC, and TLS.
  • Collaborate with internal teams (threat intelligence, detection, response) to evolve agent capabilities.
  • Perform in-depth debugging, profiling, and optimization using industry-standard tools.


Required Skills & Experience:

Core Programming:

  • Strong proficiency in C/C++ and either Golang or Rust
  • Solid experience in multi-threaded and asynchronous programming

Platform Expertise:

  • Proven experience developing for Windows, Linux, and macOS
  • Deep knowledge of system-level programming, including:
  • Windows: WinAPI, ETW, WFP, WMI, MiniFilter
  • Linux: eBPF, auditd, fanotify, netfilter
  • macOS: EndpointSecurity framework, XPC, System Extensions

Security & Networking:

  • Understanding of secure IPC, TLS, gRPC, and secure coding practices
  • Familiarity with system hardening and secure memory management

Debugging & Optimization Tools:

  • Proficient in using tools like GDB, LLDB, Valgrind, Perf, Wireshark, Sysinternals Suite

Version Control:

  • Strong experience with Git (GitHub, GitLab)

Preferred Qualifications:

  • Experience with cybersecurity frameworks like MITRE ATT&CK, Sysmon, YARA, Suricata
  • Hands-on exposure to kernel/driver development
  • Familiarity with EDR/XDR, sandboxing, and SIEM integrations
  • Understanding of malware analysis and threat detection techniques
  • Exposure to container security and cloud-native security agent development



Read more
Semperfi Solution
at Semperfi Solution
1 recruiter
Ambika Jituri
Posted by Ambika Jituri
Bengaluru (Bangalore)
5 - 10 yrs
₹10L - ₹15L / yr
Linux administration
skill iconJenkins
Ansible

Job Description

Sr Linux System Administrator

Experience: 5-10 years

Skills:

  • VMware, vCenter, ESXi Administration
  • RHEL/AIX OS Upgrades
  • RHEL and AIX Patching
  • Installation and configuration of services and software components.
  • Handling hardware failures and server crashes
  • Linux Filesystems (ext3 /4, xfs, zfs, etc.) management.
  • LVM and NFS Filesystem management
  • User Administration, PAM, LDAP
  • Ansible, Git, Jenkins, CI/CD
  • Networking
  • Handling files, directories, and users.
  • OS RHEL, Oracle Linux, Centos, UNIX AIX, others.
  • AWS, Docker, and Cloud Administration optional

Shift: Willing to work in rotational shift including weekend oncall support.

There is an option for work from home for core Night shifts and Weekend Support. Extra allowances are provided for the same

Job location : Bangalore 

Immediate to 30 days of Notice

Skills

AWS, Linux, VMware, Vcenter, ESXI, AIX Patching, RHEL, PAM, Ansible, Networking, OS RHEL, Oracle, Filesystems

Read more
Flymedia Technology
at Flymedia Technology
2 recruiters
Jasveer Kaur
Posted by Jasveer Kaur
Ludhiana
0 - 2 yrs
₹1.2L - ₹3L / yr
skill iconPHP
skill iconLaravel
Wordpress
User Interface (UI) Design
skill iconHTML/CSS
+3 more
  • Designing and implementing new features and functionality
  • Establishing and guiding the website’s architecture
  • Ensuring high-performance and availability, and managing all technical aspects of the CMS
  • Helping formulate an effective, responsive design and turning it into a working theme and plugin.
  • Self motivated.
  • Zeal to learn new things.
  • Must be proficient in PHP, MySQL, CSS, HTML, Javascript, AJAX
  • Should have experience with WordPress.
  • Knowledge of PHP web frameworks like CodeIgnit.
Read more
Top 5 Services MNC
Top 5 Services MNC
Agency job
NCR (Delhi | Gurgaon | Noida)
8 - 12 yrs
₹8L - ₹24L / yr
skill iconJava
skill iconGo Programming (Golang)
skill iconJavascript
Fullstack Developer
Microservices
+5 more
  1. Java Lead : 8-12 Years – GGN Location - NP : 60 Days max

 

  • Experience on Full stack development and Microservices Architecture.
  • Proven experience implementing distributed applications in a container environment (Docker/Kubernetes) along with considerable experience configuring and administrating Linux (or other Unix-like) systems Software engineering experience designing Enterprise Cloud Applications with Golang will be preferred
  • Experience in any Databases like Postgres or any NoSQL DB like MongoDb
  • Expertise in defining business architecture, business process definition & modelling, use cases, and requirements definition, and associated best practice processes for defining these artifacts
  • Proven proficiency in grasping requirements and building illustrative features with minimal specifications
  • Experience working in SAfe agile development environments.
Experience in handling and leading a team of engineers to meet the project objectives
Read more
leading TMT bar manufacturer and exporter in India
leading TMT bar manufacturer and exporter in India
Agency job
via Merito by Gaurav Bhosle
Kolkata
4 - 9 yrs
₹20L - ₹30L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux
skill iconNodeJS (Node.js)
RESTful APIs
Hello

About the Company

 

Established in the year 1953, Our Client is one of the leading TMT bar manufacturer and exporter in India. It  is a well known group that achieves a turn over of 3000 Cr per annum. The group is setting a construction & architecture oriented omni channel B2B & B2C platform


Job Description

Experience : 5-7Years

 

Requirement

  • 5-7years of experience in frontend development primarily using React .JS
  • Strong proficiency in JavaScript, including DOM manipulation and the JavaScript object model
  • Good foundation in design and a knack for designing interactions and elegant interfaces)
  • Thorough understanding of NodeJs & React.js(SSR) and its core principles
  • Familiarity with RESTful APIs
  • Familiarity with modern front-end build pipelines and tools
  • Familiarity with code versioning (version control) tools, such as Git, SVN, and Mercurial
  • Thorough understanding of React.js and its core principles
  • Good to have experience with popular React.js workflows
  • Ability to understand business requirements and translate them into technical requirement
  • Preference will be given to those who have worked on libraries such as Bootstrap, Material js.
  • Knowledge ofGraphQL and CSS preprocessor like SASS
  • Proficient in industry standard best practices such as Design Patterns, Coding Standards,

Coding modularity, Prototypes etc.



Regards
Team Merito

 

Read more
US based company
US based company
Agency job
via MNR Solutions by Geetanjali Kumari
Hyderabad
7 - 13 yrs
₹20L - ₹30L / yr
skill iconAmazon Web Services (AWS)
Cyber Security
Penetration testing
Threat modeling
Computer Security
+1 more

Job Responsibilities:

 

Experience: 8 Yrs to 12 Yrs

 

  1. Hands-on expertise on performing Application pen testing (Mobile(Android, IOS),networking, web application pen testing),
  2. Should worked on IOT,AWS,Application Penetration Testing, Reverse Engineering, source code review, CI/CD Pipeline
  3. have done any submission on Bug crowd or Bug Bounty.
  4. have developed tools or scripts for web pen test on GitHub.
  5. Certified on OSCP
  6. Threat Modeling
  7. Network scan in stealth mode or simple scan using Nmap and Burp suite

 

Implement security measures which monitor and protect sensitive data and systems from infiltration and cyber-attacks.

 

Developing different ways to solve the existing threats and security issues.

 

Configuring and implementing intrusion detection systems and firewalls.

 

Security product development, testing, and implementation.

 

Responsible for security technology research, penetration testing, and vulnerability scanning.

 

Please follow the below inputs.

 

The shift will starts from 03:00 PM to 12 AM (fixed for few months),

 

 

OSCP certification(Not mandatory, preferable)

 

Below are the primary key skills:

 

Total Application Security Experience:

Total Security Architecture Experience:

IOT(optional)

MOBILE

WEB

AWS(Mandatory)

NETWORKING

THREAT MODELS

 

 

Read more
its a leading company in India for ruby on rails
its a leading company in India for ruby on rails
Agency job
via Getinz by Praba karan
Remote only
4 - 8 yrs
₹1L - ₹15L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
RSpec
skill iconReact.js

Technical qualifications

  • 2+ years of working experience in delivering web applications. 
  • Strong experience in Ruby on Rails, API design and architecture.
  • Strong experience in databases like MongoDB/PostgreSQL/MySQL.
  • Strong understanding of object-oriented programming(OOPs) concepts, data structures, algorithms, APIs, web services, SQL concepts.
  • Experience in any JS frameworks like Express. js/Node. js/AngularJS/ReactJS.
  • Understanding of version control tools - Git/SVN.
  • Supportive in providing clean, maintainable code.
  • Empathize with client needs and architect custom solutions.
  • Brownie points for knowledge in Golang.
Read more
Uffizio India Software Consultants Pvt Ltd
Tushar Bhagat
Posted by Tushar Bhagat
Ahmedabad
0 - 5 yrs
₹3L - ₹8L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+1 more

Roles and Responsibilities

  • Have profound interest in Java technologies.
  • Must have accomplished academic projects using Java.
  • Understanding of OOD patterns.
  • Excellent communication skills written and oral.
  • Git or SVN experience/knowledge.
  • Proficient in Core Java, JSP, JavaScript, JDBC.
  • Knowledge in Frontend technologies ( e.g. Angular, HTML, CSS, Java Script, JSP and JQuery)
  • Knowledge in java frameworks - Spring/Spring MVC.
  • Knowledge with working with databases MYSQL/SQL.
  • Solid understanding of object-oriented principles and programming.
  • Familiar with various design and architectural patterns.

Desired Candidate Profile

  • Sound knowledge of OOPS concept
  • Ability to practice good coding standards in order to enable reusability of code.
  • Problem solving & Resilience.
  • Timely & Error free Delivery
  • Ability to perform R & D with code in order to increase product performance.
  • Keen to learn new technologies.
  • Self-Motivated Individual.

What We offer:


1. Freedom of Work

  • 5 days week
  • Flexible Timing.
  • No Bond System in any form (Training Agreement, No Blank Cheque Deposit).
  • Work from home after Domain and Product Training.

2. Work life Balance

As per the experience of more than 2 decades management of Uffizio always believes that work of software development is creative and requires many efforts hence no developer shall work more than 8 hours a day. So, we prefer 8 hours / day working standard is the normal scenario for software developers.


3.We are open to new ideas

  • You can bring new ideas / technologies without any hesitations to the management.
  • Once feasibility testing of idea is found okay then company is ready to work on your idea.

4.You will be adding new feather to your crown by getting experience of high-end German Analytics systems development while working with us.


5.WorkShops and Training Activities


6.Compensation

  • We don't follow bell curve system.
  • We judge people on their capabilities rather than their experience in number of years.
  • We offer compensation to our employees based on the values they bring to our organization not based on their tenure.
  • We have fair increment system bring values on table and claim your desired increment.
Read more
httpscarestackcom
Bengaluru (Bangalore), trivandrum, Cochin, Thiruvananthapuram
2 - 6 yrs
₹7L - ₹25L / yr
SDET
Manual testing
Software Testing (QA)
Test Automation (QA)
skill iconC#
+3 more

Mandatory Skill Requirements:

  1. Strong Fundamentals on Manual Testing.
  2. Some experience on API Automation Testing .
  3. Basic understanding of any of the coding languages.(During the interview one coding question will be asked)
  4. Basic understanding of SQL.(During the interview one SQL question will be asked)
  5. Preferred Experience ( 2-6 yrs)
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos