Cutshort logo
Global digital transformation solutions provider.  logo
Lead II - SE - AWS, Apache Spark (PySpark/Scala), Apache Kafka
Global digital transformation solutions provider.
Lead II - SE - AWS, Apache Spark (PySpark/Scala), Apache Kafka
Peak Hire Solutions's logo

Lead II - SE - AWS, Apache Spark (PySpark/Scala), Apache Kafka

at Global digital transformation solutions provider.

Agency job
5 - 8 yrs
₹11L - ₹20L / yr
Hyderabad
Skills
PySpark
Apache Kafka
Data architecture
skill iconAmazon Web Services (AWS)
EMR
Apache Airflow
Amazon S3
DMS
Amazon EC2
skill iconScala
Apache Spark
Spark
ETL
CI/CD
skill iconJenkins
Big Data
SQL
Database modeling
OLAP
OLTP
skill iconData Analytics
Automation
Automated testing
Workflow
Data engineering
Data security
HIPAA
skill iconData Science
Datawarehousing
skill iconJava
NOSQL Databases
DynamoDB
Cassandra
skill iconMongoDB
Data governance
Splunk
Dynatrace

JOB DETAILS:

* Job Title: Lead II - Software Engineering - AWS, Apache Spark (PySpark/Scala), Apache Kafka

* Industry: Global digital transformation solutions provider

* Salary: Best in Industry

* Experience: 5-8 years

* Location: Hyderabad

 

Job Summary

We are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The role involves working with large-scale batch and real-time data processing systems, collaborating with cross-functional teams, and ensuring data reliability, security, and performance across the data lifecycle.


Key Responsibilities

ETL Pipeline Development & Optimization

  • Design, develop, and maintain complex end-to-end ETL pipelines for large-scale data ingestion and processing.
  • Optimize data pipelines for performance, scalability, fault tolerance, and reliability.

Big Data Processing

  • Develop and optimize batch and real-time data processing solutions using Apache Spark (PySpark/Scala) and Apache Kafka.
  • Ensure fault-tolerant, scalable, and high-performance data processing systems.

Cloud Infrastructure Development

  • Build and manage scalable, cloud-native data infrastructure on AWS.
  • Design resilient and cost-efficient data pipelines adaptable to varying data volume and formats.

Real-Time & Batch Data Integration

  • Enable seamless ingestion and processing of real-time streaming and batch data sources (e.g., AWS MSK).
  • Ensure consistency, data quality, and a unified view across multiple data sources and formats.

Data Analysis & Insights

  • Partner with business teams and data scientists to understand data requirements.
  • Perform in-depth data analysis to identify trends, patterns, and anomalies.
  • Deliver high-quality datasets and present actionable insights to stakeholders.

CI/CD & Automation

  • Implement and maintain CI/CD pipelines using Jenkins or similar tools.
  • Automate testing, deployment, and monitoring to ensure smooth production releases.

Data Security & Compliance

  • Collaborate with security teams to ensure compliance with organizational and regulatory standards (e.g., GDPR, HIPAA).
  • Implement data governance practices ensuring data integrity, security, and traceability.

Troubleshooting & Performance Tuning

  • Identify and resolve performance bottlenecks in data pipelines.
  • Apply best practices for monitoring, tuning, and optimizing data ingestion and storage.

Collaboration & Cross-Functional Work

  • Work closely with engineers, data scientists, product managers, and business stakeholders.
  • Participate in agile ceremonies, sprint planning, and architectural discussions.


Skills & Qualifications

Mandatory (Must-Have) Skills

  1. AWS Expertise
  • Hands-on experience with AWS Big Data services such as EMR, Managed Apache Airflow, Glue, S3, DMS, MSK, and EC2.
  • Strong understanding of cloud-native data architectures.
  1. Big Data Technologies
  • Proficiency in PySpark or Scala Spark and SQL for large-scale data transformation and analysis.
  • Experience with Apache Spark and Apache Kafka in production environments.
  1. Data Frameworks
  • Strong knowledge of Spark DataFrames and Datasets.
  1. ETL Pipeline Development
  • Proven experience in building scalable and reliable ETL pipelines for both batch and real-time data processing.
  1. Database Modeling & Data Warehousing
  • Expertise in designing scalable data models for OLAP and OLTP systems.
  1. Data Analysis & Insights
  • Ability to perform complex data analysis and extract actionable business insights.
  • Strong analytical and problem-solving skills with a data-driven mindset.
  1. CI/CD & Automation
  • Basic to intermediate experience with CI/CD pipelines using Jenkins or similar tools.
  • Familiarity with automated testing and deployment workflows.

 

Good-to-Have (Preferred) Skills

  • Knowledge of Java for data processing applications.
  • Experience with NoSQL databases (e.g., DynamoDB, Cassandra, MongoDB).
  • Familiarity with data governance frameworks and compliance tooling.
  • Experience with monitoring and observability tools such as AWS CloudWatch, Splunk, or Dynatrace.
  • Exposure to cost optimization strategies for large-scale cloud data platforms.

 

Skills: big data, scala spark, apache spark, ETL pipeline development

 

******

Notice period - 0 to 15 days only

Job stability is mandatory

Location: Hyderabad

Note: If a candidate is a short joiner, based in Hyderabad, and fits within the approved budget, we will proceed with an offer

F2F Interview: 14th Feb 2026

3 days in office, Hybrid model.

 


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Noida
3 - 5 yrs
₹8L - ₹13L / yr
skill iconPython
Automation
JSON
RESTful APIs
Windows Azure
+1 more

Company Overview:


Euphoric Thought Technologies is a dynamic and innovative technology company specializing in providing cutting-edge automation solutions for businesses across various sectors. We empower organizations to streamline their processes, enhance efficiency, and achieve significant cost savings through intelligent automation strategies. Our expertise spans across diverse platforms, enabling us to deliver tailored solutions that meet the unique needs of our clients.


Role Overview:


As a Python Automation Developer at Euphoric Thought Technologies, you will be instrumental in designing, developing, and implementing robust automation frameworks and scripts to ensure the quality and reliability of our software solutions. You will collaborate closely with development, QA, and DevOps teams to identify automation opportunities, build efficient test suites, and contribute to continuous integration and continuous delivery (CI/CD) pipelines. Your work will directly impact the speed and quality of our software releases, enabling us to deliver exceptional value to our customers.


Key Responsibilities:


- Design and develop automation frameworks using Python to validate .Net and C# based applications.


- Create and maintain automated test scripts for REST APIs, focusing on JSON data validation.


- Integrate automated tests into CI/CD pipelines using Azure DevOps to ensure continuous testing.


- Collaborate with developers and QA engineers to identify and resolve defects, improving overall software quality.


- Analyze test results and generate comprehensive reports to communicate testing progress and identify areas for improvement.


- Contribute to the development of automation best practices and standards to enhance team efficiency.


- Maintain and enhance existing automation frameworks to adapt to evolving project requirements.


- Participate in code reviews to ensure code quality and adherence to coding standards.


Required Skillset:


- Demonstrated proficiency in Python programming for automation, including experience with relevant libraries and frameworks.


- Solid understanding of software testing principles and methodologies, with experience in developing and executing automated test cases.


- Experience with REST API testing and JSON data validation.


- Familiarity with .Net and C# development environments.


- Experience with Azure DevOps for CI/CD and test automation.


- Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex technical issues.


- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.


- Bachelor's degree in Computer Science or a related field.

Read more
TestMu AI (Formely LambdaTest)
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
3 - 8 yrs
₹12L - ₹16L / yr
Demand generation
Sales

Account-Based Marketing (ABM) Manager

Location: Noida (Work from Office)



About the Role

We are looking for a highly strategic and execution-focused Account-Based Marketing (ABM) Manager to drive targeted growth across high-value enterprise accounts. This role sits at the intersection of marketing and sales, owning personalized campaigns that directly impact pipeline and revenue.

You will work closely with Sales, Product Marketing, and Demand Generation teams to design and execute tailored outreach strategies for key accounts globally.


Key Responsibilities

  • ABM Strategy & Execution Design and execute account-based marketing programs for targeted enterprise accounts
  • Identify and prioritize high-value accounts in collaboration with sales teams
  • Campaign ManagementPlan and run multi-channel campaigns (email, LinkedIn, events, content syndication)
  • Drive personalized messaging tailored to specific accounts, industries, and personas
  • Sales AlignmentPartner closely with Account Executives and SDRs to align on account plans and outreach
  • Enable sales teams with insights, messaging, and campaign support
  • Data & InsightsLeverage intent data, CRM insights, and marketing automation tools to refine targeting
  • Track, measure, and optimize campaign performance and ROI
  • Content & PersonalizationWork with content and product marketing teams to create account-specific assets
  • Develop use-case driven narratives for enterprise buyers (CTOs, QA Heads, Engineering Leaders)
  • Pipeline ContributionOwn ABM-driven pipeline generation and influence revenue outcomes
  • Continuously experiment and improve conversion across the funnel



Requirements

  • 3–7 years of experience in B2B Marketing / Demand Generation / ABM
  • Strong understanding of SaaS, enterprise sales cycles, and developer tools ecosystem (preferred)
  • Proven experience in running targeted campaigns for enterprise accounts
  • Hands-on experience with tools like HubSpot, Salesforce, Marketo, Outreach, LinkedIn Campaign Manager, Demandbase (good to have)
  • Strong analytical mindset with ability to translate data into actionable insights
  • Excellent communication and stakeholder management skills


What We’re Looking For


  • Strategic thinker with a revenue-first mindset
  • High ownership and ability to operate in a fast-paced, high-growth environment
  • Strong collaboration skills across sales, marketing, and product teams
  • Creative approach to personalization and engagement for linkedin messages/ Leads account based messages + timeline post


Read more
NeuraMach AI
at NeuraMach AI
2 candid answers
Vivek Pandya
Posted by Vivek Pandya
Pune
0 - 2 yrs
₹5000 - ₹15000 / mo
Product Management
Product design
Product Strategy
User Experience (UX) Design
Wireframing
+1 more

Product Management Internship – NeuraMach.AI

Location: Pune (Onsite) | Stipend: 0 – ₹15K/month | Duration: 3-6 months | Start: Immediate


About NeuraMach.AI

NeuraMach.AI is an AI-first technology company building adaptive systems using AI, ML, VR, and web/mobile development. Our mission is to transform how individuals engage with digital experiences—leveraging research-driven design, intelligent automation, and personalized interactions. Backed by professionals from top institutions, we are building next-gen tools that drive innovation and creativity.


We’re looking for a motivated Product Management Intern to join our Pune team. This is a full-time internship (3–6 months) with the potential for a full-time offer.


What you’ll do

Don multiple hats — work as a product intern, founders’ office associate, and problem-solver across teams.

Support product strategy, roadmap & execution.

Conduct market research, competitor mapping, and user analysis.

Collaborate with AI/ML/VR engineers for smooth development.

Define KPIs, draft feature specs & write user stories.

Assist in product launches & GTM execution.

Analyze user engagement data to propose improvements.


What we’re looking for

Students/recent grads in Business, CS, Engineering (or related).

Strong analytical mindset with a passion for AI-driven products.

Excellent communication & collaboration skills.

Bonus: exposure to Agile, UX, or wireframing tools


What you’ll gain

Direct experience building production-level AI systems.

1:1 mentorship from experienced AI professionals.

Opportunity to contribute to internal research & prototyping.

Flexible work culture, meaningful projects, and real ownership.

Certificate of completion + high chance of full-time placement.

Read more
Tele Sales
Tele Sales
Agency job
via The Hub by Sridevi Viswanathan
Bengaluru (Bangalore)
2 - 5 yrs
₹2L - ₹3.5L / yr
Business Development
Customer Relationship Management (CRM)
skill iconGoogle Analytics

Roles and Responsibilities

- Calling people who have filled the signup or contact form

- Finding leads online/offline who match the criteria of the target customer

- Make cold calls to the leads generated

 

- Handle both outbound/inbound calls

- Update systems, CRMs, Excels, Google Sheets

- Give platform demo to interested customers

- Write articles/knowledge base for tutorials on how to use the product

- Support customers for any queries about the product

 

Desired Candidate Profile

- Should have great convincing skills

- Should have strong negotiating skills

- Should be able to pitch the client understand the customer instead of repeating a fixed sales pitch

- Should have always achieved targets or beyond

- Should be able to Tech Savvy

- Go-getter attitude, self-starter, instead of manager or management having to follow up to get work done or to remind about targets

- Well organized with handling data, sales funnel and reaching out to the customers on time

- Soft-spoken and delight for customers to speak to

- Must have email writing skills to follow up or share information

- Can be on phone for a long time and familiar with using dialer systems

 

 

Read more
B2B2C tech firm backed by India’s largest retailer
B2B2C tech firm backed by India’s largest retailer
Agency job
via Merito by Gaurav Bhosle
Bengaluru (Bangalore)
3 - 10 yrs
₹25L - ₹30L / yr
skill iconJava
skill iconKotlin
skill iconAndroid Development
Model-View-View-Model (MVVM)
RxJava
+3 more
Hello

About our Client

Our client is a B2B2C tech firm backed by India’s largest retailer and tech venture capitalist founded by founders - IITB Graduates who are experienced in retail, ecommerce and fintech

 

It aims to become one app to manage all your brands loyalty points, cashback and coupons. It will have additional content and discovery layer for customers and brands for further engagement and commerce.

 

The company currently powers closed-loop loyalty programs for all different brands under its parent retail group. Currently, it has 20Mn+ registered customers and 3Mn MAU across 8 brands. Its vision is to be at the center of D2C Brands and the consumer consumption ecosystem

 

Responsibilities and Duties
- Develop React Native and Android Mobile Applications from design
- Can analyse requirements and communicate with clients
- Must have proficiency in communication
- Should have knowledge of Core Android, Java, Kotlin, React Native, MySQL, SQLite, MVVM, MVP and MVC.
- Work on bug fixes and improvement of Mobile applications.
- Preferred to have knowledge in React Native and Android both.

 

Required Experience, Skills and Qualifications
- 3 + years of experience in Android development.
- Minimum 1 Year experience in React Native development.
- BE/MS/MCA/PGDCA degree in Computer Science, Engineering or a related subject.
- Have worked on ReactJS Projects

Regards
Team Merito

Read more
Our Client company is into Telecommunications(SY1)
Our Client company is into Telecommunications(SY1)
Agency job
via Multi Recruit by Sukanya J
Bengaluru (Bangalore)
7 - 10 yrs
₹10L - ₹17L / yr
Information systems
MS Exchange Server
Axure
  • MS exchange: 4-5 Years of experience in Version upgrade and migration, Designing, Troubleshooting
  • Azure: 3-4 years of experience in Designing, Maintenance, and Advanced utilization
  • AD, DNS, DHCP: 4-5 Years of experience in Version upgrade, maintenance and advanced troubleshooting, PCI compliance experience
  • SCCM: 2-3 years of experience in OS build and deployment, Patch management
  • JAMF: 2-3 years of experience in App deployment and patch management

 

Read more
vSplash Techlabs
at vSplash Techlabs
2 recruiters
Abhiram Reddy Vintha
Posted by Abhiram Reddy Vintha
Hyderabad
2 - 6 yrs
₹4L - ₹12L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconAngular (2+)
skill iconAngularJS (1.x)

Description:

Are you curious, persistent, logical and clever – a true 'Techie' at heart? …..

Do you enjoy living by the code of your craft and developing elegant solutions for complex problems? ........

If this sounds like you, this could be the perfect opportunity to join BuzzBoard as an Angular Developer. Scroll down to learn more about the position’s responsibilities and requirements.

We are looking for an Angular Developer to join our awesome team and deliver a streamlined user experience. We want a team member who strives to develop first class codebase using Angular best practices. As an Angular Developer, you will develop the next generation user interface for our web applications.

Who We Are:

Headquartered in San Francisco, BuzzBoard is a leader in the data knowledge platform. We help media and tech companies across the globe to grow their businesses. We provide data, insights and recommendations to B2SMB companies to help them deeply understand their customers and build trusted relationships.
BuzzBoard is a powerful tool to help businesses drive more sales through deeper, more personalized engagement with their customers and leads.

We align our hiring practices with our core values that include:

  • We are passionate for hard work, desire to succeed and have fun in the process
  • We put our reputation first, always
  • We relish and fuel the entrepreneurial spirit in everyone
  • We believe company growth ties us to our collective future
  • We are first to respond to customer and team member needs

Responsibilities:

  • Work cross-functionally and collaboratively to develop an application using open source technologies.
  • Create single page applications using HTML, Angular, node.js and javascript, based on user stories with documented acceptance criteria.
  • Troubleshoot issues and create code fixes for open source products.
  • Address defects and collaboratively work with functional and technical teams to integrate applications in cloud environment.
  • Work in a fast-paced, agile environment consisting of a cross-functional team designing and implementing systems from the web-based user interface front-end through the back-end.

Requirements

  • Strong Knowledge on Javascript.Strong Knowledge on Angular 2, Angular 5 and above
  • Communicating with external web services.
  • Cooperating with the back-end developer in the process of building the RESTFUL API.
  • Execute unit test cases in Angular frameworks.
  • Good Knowledge on HTML, CSS.
  • Good Understanding on OOPS.
  • Good debugging skills required and able to understand existing code and logic.
  • Having knowledge on Jquery and Nodejs is added advantage.
  • Should be interested in R&D’s and integrations.
  • Knowledge on PHP will be an added advantage
  • Good communication skills, learning knowledge and analytical capabilities.

Benefits

Corporate Health Insurance, Tax optimization, Earned Leaves, Wellness activities and Fun filled culture

Read more
Hiring for TOP MNC Bpo's - Customer / Technical Support
Hiring for TOP MNC Bpo's - Customer / Technical Support
Remote, Bangalore
2 - 7 yrs
₹2L - ₹4L / yr
Customer Support
Communication Skills
BPOS
Business Process Outsourcing (BPO)
Voice processing

Hi dear Applicant,

Hiring for Multiple MNC Bpo’s, One day interview process, just 2 rounds of interview

 

Openings :

 

Customer Support : Voice & Non-voice

 

  • Health Care

  • Accounts Receivable

  • Medical Billing

  • Insurance

  • Banking / collections

  • Accounts & Finance

 

Technical Support : Voice & Non-voice

 

  • Technical Trouble Shooting

  • Hardware and Networking

  • IT Help Desk

  • Desktop Support

  • Technical Chat / Email Support

  • Application Support (Voice)

  • IT Trouble Shooting

 

Benefits :

 

  • Day / UK / US Rotational Shifts

  • 15k to 35K Take home

  • Two way Transport

  • Unlimited incentive Structure

  • No registration Fees

 

Skills Required :

 

  • Should be flexible with rotational Shifts

  • Manageable or Good English Communication Skills

  • Graduates / PUC / Diploma fresher or Experience in BPO (0-8yrs) can apply

  • Candidates with Graduation Backlogs can apply.

 

Documents Required :

 

Fresher :

  • 10th / 12th / Graduation all semester Marks card

  • Aadhar Card ID proof

  • Pan Cad ID

 

Experience :

 

  • Previous Companies Offer letter / relieving letter / one month pay slips

  • 10th / 12th / Graduation all semester Marks card

  • Aadhar Card ID proof

  • Pan Cad ID

 

 

*************PLEASE DO REFER YOUR FRIENDS*************

 

Read more
US based product engineering company
US based product engineering company
Agency job
via Sagar Enterprises by Sagar Khamkar
Remote only
5 - 13 yrs
₹30L - ₹35L / yr
DevOps
skill iconPython
CI/CD
skill iconAmazon Web Services (AWS)
skill iconDocker
+10 more

Required Skills and Experience 

 

  • 4+ years of relevant experience with DevOps tools Jenkins, Ansible, Chef etc
  • 4+ years of experience in continuous integration/deployment and software tools development experience with Python and shell scripts etc
  • Building and running Docker images and deployment on Amazon ECS
  • Working with AWS services (EC2, S3, ELB, VPC, RDS, Cloudwatch, ECS, ECR, EKS)
  • Knowledge and experience working with container technologies such as Docker and Amazon ECS, EKS, Kubernetes
  • Experience with source code and configuration management tools such as Git, Bitbucket, and Maven
  • Ability to work with and support Linux environments (Ubuntu, Amazon Linux, CentOS)
  • Knowledge and experience in cloud orchestration tools such as AWS Cloudformation/Terraform etc
  • Experience with implementing "infrastructure as code", “pipeline as code” and "security as code" to enable continuous integration and delivery
  • Understanding of IAM, RBAC, NACLs, and KMS
  • Good communication skills

 

Good to have:

 

  • Strong understanding of security concepts, methodologies and apply them such as SSH, public key encryption, access credentials, certificates etc.
  • Knowledge of database administration such as MongoDB.
  • Knowledge of maintaining and using tools such as Jira, Bitbucket, Confluence.
  • Work with Leads and Architects in designing and implementation of technical infrastructure, platform, and tools to support modern best practices and facilitate the efficiency of our development teams through automation, CI/CD pipelines, and ease of access and performance.
  • Establish and promote DevOps thinking, guidelines, best practices, and standards.
  • Contribute to architectural discussions, Agile software development process improvement, and DevOps best practices.

 

Read more
https://www.Kidzig.com
at https://www.Kidzig.com
1 recruiter
Admin Kidzig
Posted by Admin Kidzig
NCR (Delhi | Gurgaon | Noida), okhla, Badlapur
1 - 3 yrs
₹3L - ₹4L / yr
skill iconHTML/CSS
skill iconAngularJS (1.x)
Adobe Photoshop
Interaction Design
Mockups
+2 more
Hi, We at Kidzig.com are looking for 'Product/Design/UX Head' to join us. Someone who likes challenges, risks and has entrepreneurial Passion. Either someone who is already working in a Head of UX role, (maybe feeling constrained by your existing organisation and approach and can see an opportunity to make changes) or an established Senior UX designer looking to take the next step in their career. To be considered for the role you will need; You’ll be something of an expert on Agile processes. You’ve worked multiple projects and you’re able to improve ways of working across teams to improve output and momentum. You get genuinely excited by rapid prototyping, testing and generally getting things out there in front of the user. Commercially savvy and creative, you will particularly enjoy finding innovative, cost effective and value-engineered design solutions for maximum customer impact. Finding Customer driven Solutions Primarily. You'll have demonstrable understanding of UX and visual design, how to leverage customer insight, analysis and strategic data to develop designs, provide design vision and excellent leadership to a small team. We’re looking for someone who is genuinely a people person, a natural influencer and leader. A good sense of humour is important, as is a natural sense of curiosity. We are looking at various options of joining, like 'Sweat Equity, Full time Employment etc.' If you think this sounds like you then we can’t wait to hear from you!
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos