Cutshort logo
Genspark logo
Senior Data Engineer
Senior Data Engineer
hirezyai's logo

Senior Data Engineer

Agency job
5 - 9 yrs
₹9L - ₹25L / yr
Bengaluru (Bangalore), Chennai, Coimbatore
Skills
Apache Kafka
Apache
MLOps
skill iconAmazon Web Services (AWS)

The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.

Key Responsibilities

  1. Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
  2. Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
  3. Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
  4. Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
  5. Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
  6. Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
  7. Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
  8. Ensure adherence to data governance, privacy, and security standards across all data handling activities.
  9. Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Genspark

Founded :
2023
Type :
Services
Size :
20-100
Stage :
Profitable

About

Empower Today,Excel Tomorrow

Read more

Candid answers by the company

What does the company do?
What is the location preference of jobs?

Empower Today,

Excel Tomorrow

Company social profiles

N/A

Similar jobs

Wissen Technology
at Wissen Technology
4 recruiters
Meghana Shinde
Posted by Meghana Shinde
Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconJava
skill iconSpring Boot
skill iconAmazon Web Services (AWS)

About Wissen Technology


Wissen Technology, established in 2015 and part of the Wissen Group (founded in 2000), is a specialized technology consulting company. We pride ourselves on delivering high-quality solutions for global organizations across Banking & Finance, Telecom, and Healthcare domains.


For more details:


Website: www.wissen.com


Wissen Thought leadership : https://www.wissen.com/articles/


LinkedIn: Wissen Technology


Role: Java Backend Developer with AWS


Key Responsibilities

● Design & Development: Build robust, scalable, and maintainable backend services using Java 17+ and the Spring Boot ecosystem.

● API Design: Develop and document RESTful for consumption by web and mobile frontends.

● Database Management: Optimize complex queries and design schemas for relational (PostgreSQL, MySQL) and/or NoSQL (MongoDB, DynamoDB) databases.

● Microservices Architecture: Contribute to the migration or maintenance of microservices, ensuring high availability and low latency.

● Code Quality: Perform thorough code reviews and write comprehensive unit, integration, and functional tests (JUnit, Mockito).

● Cloud & DevOps: Deploy and manage applications in AWS using Docker and Kubernetes.

● Collaboration: Work closely with Frontend Developers, Product Managers to translate business requirements into technical specifications.

 

Required Technical Skills

● Java Mastery: Deep understanding of Core Java, Multithreading, and Stream API.

● Frameworks: Extensive experience with Spring Boot, Spring Security, and Spring Data JPA/Hibernate.

● Cloud Experience: Proficiency with cloud-native services (e.g., AWS Lambda, S3, RDS, or SQS).

● Messaging: Experience with message brokers like Apache Kafka for asynchronous processing.

● CI/CD: Hands-on experience with Jenkins, GitLab CI, or GitHub Actions.

● Version Control: Expert-level knowledge of Git and branching strategies.


Qualifications & Soft Skills

● Experience: 5+ years of professional experience in backend development.

● Problem Solving: Ability to debug complex production issues and performance bottlenecks.

● Communication: Excellent verbal and written communication skills—vital for a remote/hybrid contractor setup.

● Adaptability: Proven ability to quickly learn new codebases and business domains.

Read more
Leader in cross-border property purchase & Prop-Tech
Leader in cross-border property purchase & Prop-Tech
Agency job
via FxConsulting by Ankit Yadava
Hyderabad
4.7 - 10 yrs
₹30L - ₹40L / yr
skill iconJava
J2EE
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)
+3 more

About the Role -


We’re seeking a seasoned Senior Java Engineer to drive the development of our B2B product suite. In this pivotal role, you will build robust, scalable, and intuitive applications that empower customers to seamlessly handle money movement transactions, including international payments. You will ensure technical excellence by advocating best practices, prioritizing security, enhancing development processes, and championing a quality-first mindset.


What You'll Do -


• Design and Development: Create robust, efficient, and scalable backend services using Java and Spring Boot.

• API Development: Design, build, and maintain APIs for web and mobile applications.

• Performance and Security: Ensure application performance, scalability, and security best practices.

• Cloud Integration: Collaborate with cross-functional teams to integrate cloud services into our backend infrastructure.

• Code Quality: Write high-quality, maintainable code that adheres to industry standards.

• Mentorship: Support junior and mid-level team members, conduct code reviews, and foster a culture of continuous improvement.


What You’ll Need -


• 5+ years of professional experience as a Backend Engineer.

• Experience showing strong problem-solving skills and a passion for creating user-centric solutions.

• Core Java proficiency. A strong command of the Java language, including object-oriented programming, design patterns, exception handling, and memory management.

• Spring Framework (including Spring Boot)- In-depth knowledge of Spring, especially Spring Boot for building efficient and scalable backend applications.

• Understanding of Spring components like controllers, services, repositories, and security.

• RESTful API Development: Proficiency in designing and implementing RESTful APIs.

Bonus Points -


• Mastery over Java’s core APIs, such as collections, streams, and concurrency frameworks.

• Experience within a B2B fintech environment would be highly desirable

• Database-driven performance query optimization and Kafka messaging systems

We welcome people from all backgrounds who seek the opportunity to help build a future where we connect the dots for international property payments. If you have the curiosity, passion, and collaborative spirit, work with us, and let’s move the world of PropTech forward, together.

Redpin, Currencies Direct and TorFX are proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, colour, religion, national origin, disability, protected veteran status, age, or any other characteristic protected by law.

Read more
nymbleUP
Remote, Mumbai
3 - 5 yrs
₹8L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconPostgreSQL
skill iconAmazon Web Services (AWS)
skill iconKubernetes
+1 more
Job Summary
We are looking for a passionate backend developer with 2-3 years of experience who loves challenges and building something from ground-up. Past track record of building a statistical tool will be an advantage

Responsibilities and Duties
- Design of system and architecture for all features and problems
- Translate high level business problems into scalable design and code
- Maintain existing backend code and infrastructure
- Working with team to solve problems and discuss new ideas
- Smart system design smart having a balance between speed of implementation and scalability
- Ownership of projects or codes written

Qualifications and Skills
- Passion to work for startup and aptitude for fast learning
- In-depth understanding of Django and Django Rest Framework
- Expertise in python
- Basic machine learning knowledge, Company will help the candidate to upskill
- Ability to write clean, scalable, robust code
- Understanding of complete lifecycle of software development
- Basic knowledge of front-end development
- Good understanding of restful api design
- Working knowledge of AWS (EC2, RDS and Postgresql)
- Familiarity deploying SAAS solution with Amazon AWS and Docker (Kubernetes) etc
Read more
Product based company-Startup
Product based company-Startup
Agency job
Chennai
7 - 16 yrs
₹8L - ₹16L / yr
skill iconJava
Microservices
JUnit
skill iconElastic Search
skill iconAmazon Web Services (AWS)

RESPONSIBILITIES

  • New features developed independently with the ability to document the design after understanding and evaluating the requirements with necessary groundwork on required application components
  • Hands-on coding to implement the design for feature completion
  • Able to write unit tests that ensures bug free code
  • Able to handle the multi-tenant and performance requirements of the new features and applications.
  • Integrate the new features with existing modules, deliver ready to use code meeting necessary build requirements and CI/CD requirements.
  • Work with other functional groups for product, technology, QA, tech support and deployment team.

QUALIFICATIONS

The ideal candidate must have the following qualifications.

  • BE/B.Tech Degree from a reputed institution with at least 7 years of relevant experience
  • Hands-on experience with Core Java, J2EE with a good knowledge of its ecosystem
  • Experience with JUnit, JMH like performance tuning test tools preferred
  • REST API design and development experience. Usage of Swagger or other API spec tools would be preferred. Working knowledge on Spring Boot is a plus
  • Hands-on experience with some of the following application components is a plus: Solr, Kafka, OpenTSDB, Elasticsearch, Janus graph or any graph DB.
  • Experience with databases such as MongoDB, MySQL or PostgreSQL required.
  • Familiarity with continuous integration and build tools such as Jenkins or CircleCI, Maven, Ant required
  • Experience building applications using microservices architecture is highly preferred. Knowledge of Kubernetes, Docker would be ideal
  • Working knowledge on public clouds like AWS or Google cloud or Azure is a plus
  • Experience building scalable systems
  • Strong problem solving skills and ability and interest to solve complex problems
  • Interest in machine learning (ML) data science is a plus
Read more
NetElixir
at NetElixir
1 recruiter
Krati Vijayvargiya
Posted by Krati Vijayvargiya
Hyderabad
3 - 5 yrs
₹7L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconFlask
SQL
NOSQL Databases
+2 more

About NetElixir: 

NetElixir is a global digital marketing firm headquartered in Princeton, NJ. With a common goal of helping our customers and challenging ourselves to think differently, we face challenges and tackle them together as a team. We are a close-knit group of imaginative and friendly industry experts who bring our unique passions and personalities together to find creative solutions that drive results.

With offices in the US and India, NetElixir works persistently gathering, evaluating, computing, and formulating raw data and turning it into actionable insights for our customers. We work consistently to develop new technology that will improve and facilitate digital marketing efforts across the globe.

 

Role: Python Developer

Experience: 3 -5 Years

Company Website: http://www.netelixir.com/">www.netelixir.com 

 

 

Job Description:

 

Your responsibilities will include understanding the needs, gathering and prioritizing requirements, and working with our software development teams to design, develop and deliver new features.

  • 3-5 years of experience in building web applications and product development using Python
    ● Experience in Python Backend development, microservice API development using Flask and/or Django
    ● Experience in SQL and No SQL databases
    ● Experience in AWS cloud services
    ● Working knowledge in Unit testing with pytest, Git (versioning, branching, etc..), CI-CD
    ● Collaboration with technical teams and product stakeholders to ensure design and
    implementation is aligned with business requirements
    ● Perform design and code reviews to ensure products meet our quality standards
    ● Assist in the education and development of junior team members to ensure progression and
    improvement.
    ● Good hands-on experience in debugging application issues
    ● Work experience in developing and deploying AI/ML models (additional advantage)
    ● Exposure to Digital Marketing Domain (additional advantage)

 

 

Read more
Viaan Industries
at Viaan Industries
1 recruiter
Shweta Parab
Posted by Shweta Parab
Andheri, Mumbai
6 - 12 yrs
₹18L - ₹24L / yr
skill iconMongoDB
skill iconNodeJS (Node.js)
skill iconAmazon Web Services (AWS)
Cloud Computing
MySQL
+4 more

Architectural:

Design and implement a software architecture

Select a technology stack

Design and configure infrastructure

Select a development toolkit (IDE, etc.)

Design and implement a database design

Improve and optimise the application architecture

Ensure scalability of the application

Ensure scalability of the infrastructure

Explore new technologies and decide whether to implement them

 

Strategy, planning, and design:

  • Take end-to-end ownership of the product, identify technology requirements, define the future product vision, create preliminary design concepts for add-on modules and shape overall technology and product roadmap by collaborating with the founders, business development, and marketing team.
  • Ensure user oriented design is the primary approach to product development across multiple screens, based on user behaviour data and direct customer feedback.

 

Implementation and deployment:

  • Manage Product Release, QA cycles, feature implementation and on time delivery through in-house team and vendors.
  • Collaborate with team and customers to define use cases.
  • Creation of wireframes/prototypes, site maps and user-flows for web and mobile platforms.

 

Operational management :

  • Support marketing by implementing technical requirements for SEO/product analytics.
  • Establish and supervise a quality assurance process, including integration & system testing.
  • Rigorously monitor key performance metrics and coordinate with various teams to take corrective actions if needed.
  • Establish and forecast ROI of features and succinctly articulate competitive advantage.
  • Set-up data collection and analysis system in collaboration with CEO to track key performance.

metrics.

Strong fundamentals in computer science/engineering and algorithm design.

Practical knowledge of computer software algorithms in machine/deep learning, NLP, Computer Vision etc.

 

Personal Requirements:

  • Min of 7+ years of Hands on experience in Web app development, payment gateways implementation, architecture design, product management, databases and UI/UX in consumer facing applications.
  • Experience on projects involving engineering and algorithmic functions, machine learning, deep learning and artificial intelligence is very advantageous.
  • Creative self-starter who is comfortable with both taking initiative and working in teams.
  • Strong communication skills.
  • Willingness to learn and utilise emerging technologies.
  • Sincere passion to use disruptive technologies that can be globally significant
Read more
Vamstar
at Vamstar
3 recruiters
Sayantan Paul
Posted by Sayantan Paul
Remote only
2 - 4 yrs
₹5L - ₹10L / yr
skill iconPython
skill iconAmazon Web Services (AWS)
Vamstar is a data science powered B2B healthcare marketplace that helps suppliers find the most relevant healthcare contracting leads using Artificial Intelligence (AI). We apply real-time machine learning forecasts, analyse buyers and competitor behaviours, and perform analytics at scale.

We are looking for a full-time remote Senior Backend Developer who has worked with big data and stream processing, to solve big technical challenges at scale that will reshape the healthcare industry for generations. You will get the opportunity to be involved in the big data engineering, novel machine learning pipelines and highly scalable backend development. The successful candidates will be working in a team of highly skilled and experienced developers, data scientists and CTO.

Job Requirements

1) Writing well tested, readable code using Python that is capable of processing large volumes of data

2) Experience with cloud platforms such as GCP, Azure or AWS are essential

3) The ability to work to project deadlines efficiently and with minimum guidance

4) A positive attitude and love working within a global distributed team

Skills

1) Highly proficient working with Python

2)Comfort working with large data sets and high velocity data streams

3) Experienced with microservices and backend services

4) Good relational and NoSQL database working knowledge

5) An interest in healthcare and medical sectors

6) Technical degree with minimum of 2 plus years- backend data heavy development or data engineering experience in Python

7) Desirable ETL/ELT

8) Desirable Apache Spark and big data pipelines, and stream data processing (e.g. Kafka, Flink, Kinesis, Event Hub)
Read more
Revolo Infotech
at Revolo Infotech
1 recruiter
Nitin Shenoy
Posted by Nitin Shenoy
Remote, Mumbai
1 - 3 yrs
₹2.5L - ₹5L / yr
skill iconPHP
MySQL
skill iconjQuery
skill iconHTML/CSS
skill iconJavascript
+3 more

We are looking for creative and smart candidates who are passionate about Web Development, can manage projects/teams and handle clients on a day to day basis.

The candidate must have 1 year - 2 years of experience.

We specialize in web-based software solutions for Finance, logistics, supply chain management, and inventory management. We have also created smart systems for several organizations and are relied on by organizations across India.

Read more
Doctor Insta
at Doctor Insta
3 recruiters
Ruchika Chauhan
Posted by Ruchika Chauhan
NCR (Delhi | Gurgaon | Noida)
2 - 7 yrs
₹7L - ₹12L / yr
skill iconAngularJS (1.x)
skill iconHTML/CSS
skill iconJava
skill iconPython
skill iconJavascript
+4 more
Skills Required: 1. Hands on experience with Python, Django, Databases like MySQL 2. Hands-on software development, team management and project management experience. 3. Experience with Cloud technologies like AWS, CI/CD Processes 4. Good understanding of HTML, CSS, JAVA Script, Angular JS 5. Data structure and implementing optimized algorithms 6. Experience using code versioning systems like SVN, GIT is desirable 7. Additional Qualifications –node.js, npm, NoSQL (Redis) 8. Quick Learner, Creative Problem Solver and Resourceful Education Qualifications: BTech/ BE
Read more
Social Cops
at Social Cops
1 recruiter
Dharmik Gohel
Posted by Dharmik Gohel
NCR (Delhi | Gurgaon | Noida)
3 - -2 yrs
₹6L - ₹15L / yr
Game Design
Agile/Scrum
skill iconC++
skill iconJava
skill iconC#
+5 more
As a Back-End Developer, you will serve as the gatekeeper to all data at SocialCops. You will abstract away complex data interactions with easy-to-use APIs that will power web applications. While data should be easily accessible to those who need it, you must also ensure that it does not fall into the wrong hands.The ideal Back-End Developers are polyglots who are fluent in HTTP and always pick the right set of tools for the job at hand. They understand what it takes to work in a startup environment and know when to trade performance for development speed. They are critical to the success of many products at SocialCops. They fail fast, learn faster, and execute almost instantly.Interested, but not ready to apply just yet? Sign up for updates from our team, and we'll keep you updated about how we're growing and tell you about future opportunities as they come up!Last date to apply: 31st August. Applications are processed on a rolling basis, so apply as soon as you can! WHY US?* Work with a team of engineers, growth marketers, designers, and entrepreneurs, all united by a common mission to drive the most important decisions that will affect humanity.* Work on complex data problems.* Our fail wall will be your claim to fame.KEY RESPONSIBILITIES* Analyze, design and develop tests and test-automation suites.* Design and develop a processing platform using various configuration management technologies.* Test software development methodology in an agile environment.* Provide ongoing maintenance, support and enhancements in existing systems and platforms.* Collaborate cross-functionally with data scientists, business users, project managers and other engineers to create elegant solutions.* Provide recommendations for continuous improvement.* Work alongside other engineers on the team to consistently apply best practices and improve our technology.BASIC QUALIFICATIONS* A Bachelor’s degree in Computer Science or equivalent combination of technical education and work experience.* Strong, object-oriented design and coding skills (C/C++ and/or Java/C# on a UNIX or Linux/Windows platform).* Solid software development background, including design patterns, data structures, and test-driven development.* Solid experience with distributed (multi-tiered) systems, algorithms, and relational databases.* Software development experience in AWS, S3, building web services and highly scalable applications or equivalent.* Proficiency using modern web development technologies and techniques, including JavaScript, Python, web services, etc.* Strong analytical skills, with excellent problem-solving abilities.* Strong customer focus, ownership, urgency and drive.* Leadership qualities of hustle, curiosity and generosity.* Excellent verbal and written communication skills.About SocialCopsSocialCops is a data intelligence company that is empowering leaders in organizations globally including the United Nations & Unilever. Our platform powers over 150 organizations across 28 countries. As a pioneering tech startup, SocialCops was recognized in the list of Technology Pioneers 2018 by World Economic Forum and by the New York Times in the list of 30 global visionaries. We were also part of the Google Launchpad Accelerator 2018. Aasaan jobs named SocialCops as one of the best Indian startups to work for in 2018.Read more about our work and case studies: https://socialcops.com/case-studies/Watch our co-founder's TEDx talk on how big data can influence decisions that matter: https://www.youtube.com/watch?v=C6WKt6fJisoWant to know how much impact you can drive in under a year at SocialCops? See our 2017 year in review: https://socialcops.com/2017/For more information on our hiring process, check out our blog: https://blog.socialcops.com/inside-sc/team-culture/interested-joining-socialcops-team-heres-need/
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos