Cutshort logo
Genspark logo
Senior Data Engineer
Senior Data Engineer
Genspark's logo

Senior Data Engineer

Agency job
5 - 9 yrs
₹9L - ₹25L / yr
Bengaluru (Bangalore), Chennai, Coimbatore
Skills
Apache Kafka
Apache
MLOps
skill iconAmazon Web Services (AWS)

The candidate should have extensive experience in designing and developing scalable data pipelines and real-time data processing solutions. As a key member of the team, the Senior Data Engineer will play a critical role in building end-to-end data workflows, supporting machine learning model deployment, and driving MLOps practices in a fast-paced, agile environment. Strong expertise in Apache Kafka, Apache Flink, AWS SageMaker, and Terraform is essential. Additional experience with infrastructure automation and CI/CD for ML models is a significant advantage.

Key Responsibilities

  1. Design, develop, and maintain high-performance ETL and real-time data pipelines using Apache Kafka and Apache Flink.
  2. Build scalable and automated MLOps pipelines for training, validation, and deployment of models using AWS SageMaker and associated services.
  3. Implement and manage Infrastructure as Code (IaC) using Terraform to provision and manage AWS environments.
  4. Collaborate with data scientists, ML engineers, and DevOps teams to streamline model deployment workflows and ensure reliable production delivery.
  5. Optimize data storage and retrieval strategies for large-scale structured and unstructured datasets.
  6. Develop data transformation logic and integrate data from various internal and external sources into data lakes and warehouses.
  7. Monitor, troubleshoot, and enhance performance of data systems in a cloud-native, fast-evolving production setup.
  8. Ensure adherence to data governance, privacy, and security standards across all data handling activities.
  9. Document data engineering solutions and workflows to facilitate cross-functional understanding and ongoing maintenance.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Genspark

Founded :
2023
Type :
Services
Size :
20-100
Stage :
Profitable

About

Empower Today,Excel Tomorrow

Read more

Candid answers by the company

What does the company do?
What is the location preference of jobs?

Empower Today,

Excel Tomorrow

Company social profiles

N/A

Similar jobs

IT Services Firm
IT Services Firm
Agency job
Pune
3 - 5 yrs
₹2L - ₹9L / yr
skill iconJava
skill iconSpring Boot
J2EE
RESTful APIs
Hibernate (Java)
+14 more
Hi,
We are looking for java developers with the following skill sets
Experience - 3+ years of experience in IT sector with exposure to non-banking porjects
 
 
MUST to Have
  • 3+ years of Experience in software Design and development and familiar with technologies - Java, Java-J2EE, Spring Boot, Hibernate, Ajax, REST API, Micro services etc.
  • Working knowledge of JVM internals
  • Working knowledge of any database (MySQL or HSQLDB)
  • Working knowledge of No-SQL database (Mongo or Dynamo DB)
  • Working experience with messaging (JMS/RabbitMQ)
  • R & D on new advanced cloud-based technologies in a test-driven agile development.
  • Knowledge in designing and architecting systems with high scalability and performance requirements.
  • Ability to understand infrastructure for performance evaluation and reporting of cloud-based services, namely AWS
  • knowledge of key AWS services like EC2, S3, Lambda, CloudWatch etc.
  • Certification on AWS Fundamendals
  • Excellent communication skills
  • ability to effectively articulate technical challenges and solutions
  • skilled in interfacing with internal and external technical resources
  • Good in debugging problems and mentoring teams on technical front
 
 
Read more
EWar Games
at EWar Games
2 recruiters
Parth Chadha
Posted by Parth Chadha
Bengaluru (Bangalore)
2 - 7 yrs
₹10L - ₹25L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
Microservices
+1 more
We are looking for an analytical, results-driven Back-end Developer who will work with team members to troubleshoot and improve current back-end applications and processes. The Back-end Developer will use his or her understanding of programming languages and tools to analyze current codes and industry developments, formulate more efficient processes, solve problems, and create a more seamless experience for users.
Responsibility and duties
• Understand the business objectives and create a weekly/quarterly roadmap for the team • Integration of user-facing elements developed by front-end developers with server-side logic.
• Reviewing the code written by subordinates to maintain quality of code
• Planning and implementing tests for the codes and fixing bugs
• Developing ideas for new programs, products, or features by monitoring industry developments and trends.
• Qualification and skills *
• Bachelor's Degree in Computer Science [Preferably B. Tech./B.E. (CSE/IT)]
• 2 Years+ experience in Back-end development • Knowledge of Redis assisted client-side caching
•Intermediate skill in Amazon Web Services frameworks and modules • Familiarity with relational or non-relational database [Preferably SQL and MongoDB]
• Familiarity with NodeJS
• Proficient in Ms Excel/Trello

EWar Games focuses on Sports, Mobile Games, Technology, Online Gaming, and Real Money Online Gaming. Their company has offices in Bengaluru. They have a small team that's between 11-50 employees.
Read more
Product based Company
Product based Company
Agency job
via New Era India by Poorti Punj
Bengaluru (Bangalore), Hyderabad, Pune, Delhi
8 - 14 yrs
₹20L - ₹60L / yr
skill iconJava
J2EE
skill iconSpring Boot
Hibernate (Java)
skill iconAmazon Web Services (AWS)

BASIC QUALIFICATIONS

 

  • At least 8+ years of IT experience most of which will have been in helping the design and implementation of the software suite/module.
  • 2+ years on any Cloud Platform (AWS, Azure, Google etc).
  • Bachelor’s degree in Information Science / Information Technology, Computer Science, Engineering, Mathematics, Physics, or a related field.
  • Strong verbal and written communication skills, with the ability to work effectively across internal and external organizations.
  • Strong programming skills in Java.
  • Strong hands-on experience in integrating multiple databases like Oracle, SQL Server, PostgreSQL etc.
  • Deep hands-on experience in the design, development and deployment of business software at scale.
  • Customer facing skills to represent AWS well within the customer’s environment and drive discussions with senior personnel regarding trade-offs, best practices, project management and risk mitigation
  • Leading/Involved in highly-available and fault-tolerant enterprise and web-scale software applications.
  • Experience in performance optimization techniques
  • High end Troubleshooting and Communication skills.
  • Proven experience with software development life cycle (SDLC) and agile/iterative methodologies required

 

PREFERRED QUALIFICATIONS

 

  • Implementing experience with primary AWS services (EC2, ELB, RDS, Lambda, API Gateway Route53 & S3).
  • AWS Solutions Architect Certified
  • Experience in programming languages like Java/Python.
  • Demonstrated ability to think strategically about business, product, and technical challenges
  • Integration of AWS cloud services with on-premise technologies from Microsoft, IBM, Oracle, HP, SAP etc.
  • Experience with IT compliance and risk management requirements (eg. security, privacy, SOX, HIPAA etc.).
  • Extended travel to customer locations may be required to sell and deliver professional services as needed
Read more
DIY
at DIY
1 recruiter
Suman Mukherjee
Posted by Suman Mukherjee
Remote only
7 - 10 yrs
₹20L - ₹30L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconAmazon Web Services (AWS)

Come be a part of one of the most exciting e-learning startup! A product based company building a B2C subscription product for kids around the world. Best understood as a combination of Netflix + Skillshare + Instagram for kids of ages 5 - 15, there is going to be something new every week to work on!

 

Already present in over 148 countries, kids of all backgrounds, languages and ages use DIY.org on website, iOS and Android. DIY is a place online where kids truly discover themselves.

 

We are looking for a Product Engineer - Senior Backend Engineer to join our early stage startup with experience in building B2C products.

 

If you have experience of working in product based companies (preferably startups), and are looking to build exciting things that children across the world will use - come talk to us!

 

What you get to do:

  • Design and build advanced applications from scratch keeping scalability and performance in mind
  • A good handle on both client and server architecture.
  • Work on bug fixing and improving application performance.
  • Comfortable in owning large scale products and continuously re-evaluating and innovating.

 

Who are we looking for:

 

  • Experience of 7+ years across product based companies
  • Should have worked on building B2C products. Having experience in building edtech products would be a major plus.
  • Should be an avid programmer with great problem solving skills.
  • Should have a great grasp over NodeJs/Typescript/ AWS microservices/DB design/System Design.
  • Should have experience in building scalable server-side systems. Should have significant experience in cloud infrastructure and designing databases.
  • Should have knowledge of software architecture, system thinking and design patterns.
Read more
Lodestone Pvt. Ltd.
at Lodestone Pvt. Ltd.
4 recruiters
Manmohan Charan
Posted by Manmohan Charan
Remote, Ahmedabad
4 - 7 yrs
₹7L - ₹15L / yr
skill iconNodeJS (Node.js)
TypeScript
skill iconExpress
CI/CD
skill iconAmazon Web Services (AWS)
+2 more

We are looking for strong Backend developers to join our growing Team and help build Software applications and Tools that help streamline enterprise processes and build efficiency.

Roles & Responsibilities:

-Well versed with Javascript / Typescript, Node.js, Node.js frameworks like Nest.js, express.js, Postgres DB (relational databases), Redis / Memcache, Queues.

- Well versed with RESTful services
- Should be able to deploy code and manage CI/CD pipeline on Microsoft Azure / AWS, GitHub skills.
- Plus points if s/he is versed with JS Unit testing frameworks, Python.
- Should be able to back his technical choices with reasoning (benefits, tradeoffs and limitations).
- Work with the development team and product manager to ideate software solutions and document cards on PM tools.
- Design client-side and server-side architecture and explain it well to technical and non-technical audiences.
- Build client and server code that is fast, testable, and high quality.
- Should be testing code thoroughly, we strongly discourage throwing code over the wall. 
- Excellent coding, problem-solving, and debugging skills
- You strive to create highly intuitive and responsive products.
- You’re a fast learner, can contribute from day one, and can bring good thoughtful opinions to the table.
- You have an excellent command of written and spoken English and communicate about what you're doing with your coworkers.
Read more
Thoughtworks
at Thoughtworks
1 video
27 recruiters
Swagata Wanjari
Posted by Swagata Wanjari
NCR (Delhi | Gurgaon | Noida)
5 - 9 yrs
Best in industry
skill iconJava
skill iconSpring Boot
skill iconC#
skill icon.NET
Microservices
+14 more

How would you leverage your technical expertise to create extraordinary impact for our clients?

ThoughtWorks is a global software consultancy with an aim to create a positive impact on the world through technology. Our community of technologists thinks disruptively to deliver pragmatic solutions for our clients' most complex challenges. We are curious minds who come together as collaborative and inclusive teams to push boundaries, free to be ourselves and make our mark in tech.

Our developers have been contributing code to major organizations and open source projects for over 25 years. They’ve also been writing books, speaking at conferences and helping push software development forward, changing companies and even industries along the way. 


You could influence the digital strategy of a retail giant, build a bold new mobile application for a bank or redesign platforms using event sourcing and intelligent data pipelines. You will use the latest Lean and Agile thinking, create pragmatic solutions to solve mission-critical problems and challenge yourself every day.

For a team to thrive, it needs active collaboration and room for healthy, respectful debate. Senior Developers are the technologists who cultivate this environment while driving teams toward delivering on an ambitious tech vision and acting as mentors for more junior-level consultants. They leverage their deep technical knowledge to solve more complex business problems and actively assess their team’s health, code quality and nonfunctional pipelines. 

You’ll spend time on the following:

  • You will use continuous delivery practices to deliver high-quality software as well as value to end customers as early as possible.
  • You will work in collaborative, value-driven teams to build innovative customer experiences for our clients
  • Create large-scale distributed systems out of microservices
  • You will apply the latest technology thinking from our tech radar to solve client problems
  • Efficiently utilize DevOps tools and practices to build and deploy software
  • You will lead or take part in the entire cycle of software consulting and delivery from ideation to deployment and everything in between
  • You will act as a mentor for less-experienced peers through both your technical knowledge and leadership skills 

Here’s what we’re looking for:

  • You have at least 5 years of experience with two or more development languages such as Java, C#, or Ruby
  • You can skillfully write high-quality, well-tested code and you are comfortable with Object-Oriented programming
  • Presence in the external tech community: you proactively share your expertise with others via speaking engagements, contributions to open source, blogs and more
  • Comfortability with Agile methods, such as Extreme Programming (XP), Scrum and/or Kanban
  • You enjoy influencing others and always advocate for technical excellence while being open to change when needed 
  • You’re willing and able to commit to travel to client sites in order to solve their business problems
  • You’re resilient in ambiguous situations and can approach challenges from multiple perspectives
  • Bonus points if you have working knowledge of cloud technology such as AWS, Azure, Kubernetes and Docker
Read more
3Pillar Global
at 3Pillar Global
1 recruiter
HArmeet Khurana
Posted by HArmeet Khurana
Noida, NCR (Delhi | Gurgaon | Noida)
11 - 16 yrs
₹26L - ₹33L / yr
skill iconJava
Hibernate (Java)
skill iconAmazon Web Services (AWS)
skill iconSpring Boot

Job Description:
We are looking for talented Technical Managers to be part of the Product Engineering team. The candidate should have good experience with Java/J2ee based technologies and will be responsible for delivering features that are meaningful to the customer and consistent with the product vision through the management of a cross-functional team. The person will also contribute to the team as a servant leader and ensure that the team has everything needed to be successful.

 

Technical Competencies

  • Strong Java/J2EE development experience with demonstrated ability to develop and troubleshoot large mission applications & Software Products
  • Experience on exception handling, correct use of data structures, multi-threaded programming, memory management and application tuning
  • Excellent exposure in Object Oriented Design skills using Java/J2ee along with:
  • Core Java Language (Collections, Concurrency/Multithreading)
  • JDBC concepts (connection pooling, statement, result set)
  • Web Technologies (Struts/Struts 2, Spring (IOP, MVC, AOP), Hibernate, JSP, Web services)
  • Database optimization and profiling
  • Core/JEE/Integration Design patterns/UML
  • Should have experience in Unit Testing
  • Good hands on experience with RDBMS like MySQL/Oracle with ability to write SQL Queries/Stored Procedures/Triggers/Joins/View etc
  • Practical application of software product development standards and methodologies including Agile, XP, Kanban, RUP and UML
  • Ability to apply design patterns consistently and also accurate when building per design requirements
  • Good experience in source control, unit testing, code verification, documentation, automated build, continuous integration, metrics, and code reviews.
  • Demonstrated problem solving, analytic and troubleshooting skills.
  • Strong written and oral communication skills are required to effectively engage internal stakeholders and their technical representatives.

 

Responsibilities:

  • Manages the team in producing working software each iteration in accordance with the team’s commitments
  • Facilitates planning sessions, team meetings, and other “rituals,” such as the daily standup, iteration planning, iteration kickoff, iteration review, and retrospectives
  • Ensures that the backlog of work for the team is well-defined with respect to scope, clarity of requirements, and acceptance criteria
  • Helps remove roadblocks to delivery success.
  • Helps the team follow its defined process, and leads process improvement efforts
  • Understands the client’s business strategy and objectives as it relates to the product being developed; ensures that the client’s expectations are met or exceeded.
  • Oversees the completion of stories, ensuring that the team understands what “Done” means for each story.
  • Interfaces between the team and the customer
  • Communicates effectively within the team and with all stakeholders by providing high-quality visibility into planned and actual deliverables.
  • Is a model developer, with sharp coding skills and a passion for excellence
  • Participates in design and coding activities, and helps with requirements, analysis, and testing as needed
  • Ensures that the architecture of the product is sound
  • Ensures product quality through effective monitoring of quality trends, test automation, defect tracking and root cause analysis.
  • Assures that all production deliveries meet acceptance, operational, and quality criteria
  • Develops camaraderie and strong collaboration across both the 3Pillar team and client team,
  • Actively demonstrates and teaches strong consulting skills to teammates,
  • Understands the full set of product development capabilities and speaks to them holistically,
  • Proactively develops a deep "trusted advisor" relationship with the primary buyer,
  • Assists in developing strategies to take advantage of opportunities within the account and works collaboratively with the Client Partner to execute them

 

Benefits

  • A competitive annual salary based on experience and market demands
  • Flexi-timings
  • Medical insurance with the option to purchase a premium plan or HSA option for your entire family
  • In-house Food & Refreshments
  • Regular Health check-up camps arranged by the company
  • Recreational activities
  • Business casual atmosphere

Read more
StarTele Logic
at StarTele Logic
1 recruiter
Hariom Tiwari
Posted by Hariom Tiwari
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹5L - ₹7L / yr
skill iconGo Programming (Golang)
skill iconPython
FreeSWITCH
skill iconPostgreSQL
skill iconRedis
+4 more
RESPONSIBILITIES Evaluate technologies and development stacks for API based platform which scales to build largest CPaaS Own end to end life cycle of the product from requirement analysis, design, development, test, release and maintenance. Develop reusable tools/libraries Continuously improve cycle time, throughput, and code quality. Continuously improve value-adding-activities/non-value-adding activities ratio. SKILLS REQUIRED 1 - 3 years of experience Must have worked on any one or more : Golang, Django, Flask, Redis, memcache, Postgres, Celery, DynamoDB, Nginx, Linux, Git, AWS, Docker Proficient in at-least one OO language: Python/Golang(preferred) Writing high-performance, reliable and maintainable code. Excellent microservices pattern understanding. Ability to define cross core contracts and bring them to closure through collaboration. Good knowledge of database structures, theories, principles, and practices. Experience working with AWS components [EC2, S3, SNS, SQS] Analytical and problem solving skills Good aptitude in multi-threading and concurrency concepts. Working knowledge of Git and proficiency with at-least one build server: Jenkins / Travis / Bamboo Experience in Telecom domain is a plus
Read more
2020 Imaging India Ltd
at 2020 Imaging India Ltd
1 recruiter
monica raisinghani
Posted by monica raisinghani
Mumbai
5 - 7 yrs
₹1L - ₹1L / yr
Technical Architecture
skill iconJava
skill iconPython
skill iconJavascript
skill iconAmazon Web Services (AWS)
+2 more
Managing tender related activities (Understanding the tender documents, preparing pre-bid queries, tracking important dates, checking for corrigendum’s, maintaining records for that tender etc.) Preparing tender synopsis Tender documentations (MAF, SAC etc.), solution documentations (Technical proposal, solution assumptions, hardware & OS requirements Interact with eco system partners, arriving at integration methodologies, preparing system architecture, preparing solution PPT, interaction with customer & consultant on the solution proposed and making presentations, supporting sales team Full Technical rating of the tender Understanding POC requirements, Interacting with sub system vendors and development team for integration of sub-systems in to CCC for POC, Coordinating with MSI for POC requirements, demonstrating the POC to customer/MSI/Consultant Setting up standard process and check list to speed up the response to RFP
Read more
JS TechAlliance Consulting Pvt Ltd.
Kumar Anand
Posted by Kumar Anand
Indore
10 - 100 yrs
₹8L - ₹12L / yr
skill iconAmazon Web Services (AWS)
Chef
DevOps
skill iconGit
skill iconJenkins
+2 more
About Company - JS Tech Alliance is a global, Top leading, end-to-end IT services and solutions provider to businesses ranging from mid-sized to global fortune enterprises.We brings unique blend of enterprise, mobility and IT consulting solutions across all domains. We have been in IT business for over 7 years to develop an IT solutions . We are working harder and are committed to remain among the industry's leading employers for attracting global talent with a focus on quality , leadership and excellence . In order to achieve excellence in right sourcing . We intensify the base of highly skillful project managers /supervisors and invest in earning and retaining knowledge related to specific industry verticals and business practice of our client . We follows a 360-degree business approach. We partner with our customers to understand their business vision and align our services to optimize profitability, improve ROI and increase the efficiency. We help our customers leverage our global delivery model from product management to innovation. Job Description - Job Title: DevOps Engineer Project Location: Indore, M.P., India Salary : Open Job Purpose :- This position represents a unique opportunity to help drive the evolution of our messaging platform. As a software engineer with experience in DevOps, you would be responsible for evolving the core messaging and presence platform in a large scale distributed environment. Your responsibilities will include designing and developing new features and capabilities in the EDevOps based components with a focus on aggressive growth and scale. Skills Required for this position : AWS, Chef, Go, Ruby, Jenkins/Rundeck/Consul, Docker As follows : 1. Linux Admin 2. Cloud Computing ( Public Cloud : AWS/Rackspace, Private Cloud : Openstack/VMware ) 3. Deployment ( There are many tools I am using like: Capistrano, Webistrano, Jenkins, Custom shell scripts etc. ) 4. Monitoring ( Nagios, Cacti, Big brother, etc) 5. MySQL DBA ( Installtion, Configuration, Management, Replication Master-Master, Master-Slave, Multi-master) 6. Development ( Agile Methodology, MVC architecture, Custom Framework) 7. Webhosting (Various Control Panel and webhosting tools) Essential Duties & Responsibilities: Play a significant role in establishing operational processes Improve and champion our build and deployment process Develop (and automate where possible) standard operating procedures around common failure scenarios (e.g. scripted/automated rollback, failovers, escalation procedures, etc.) Monitor, analyze, and report performance statistics Consult on overall production system architecture Implement security best practice Identify root causes to critical problems throughout the platform and take necessary steps to resolve them Create and follow up on site incident reports with other members of the engineering team and see them through to resolution
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos