
Lead II - SE - AWS, Apache Spark (PySpark/Scala), Apache Kafka
at Global digital transformation solutions provider.
JOB DETAILS:
* Job Title: Lead II - Software Engineering - AWS, Apache Spark (PySpark/Scala), Apache Kafka
* Industry: Global digital transformation solutions provider
* Salary: Best in Industry
* Experience: 5-8 years
* Location: Hyderabad
Job Summary
We are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The role involves working with large-scale batch and real-time data processing systems, collaborating with cross-functional teams, and ensuring data reliability, security, and performance across the data lifecycle.
Key Responsibilities
ETL Pipeline Development & Optimization
- Design, develop, and maintain complex end-to-end ETL pipelines for large-scale data ingestion and processing.
- Optimize data pipelines for performance, scalability, fault tolerance, and reliability.
Big Data Processing
- Develop and optimize batch and real-time data processing solutions using Apache Spark (PySpark/Scala) and Apache Kafka.
- Ensure fault-tolerant, scalable, and high-performance data processing systems.
Cloud Infrastructure Development
- Build and manage scalable, cloud-native data infrastructure on AWS.
- Design resilient and cost-efficient data pipelines adaptable to varying data volume and formats.
Real-Time & Batch Data Integration
- Enable seamless ingestion and processing of real-time streaming and batch data sources (e.g., AWS MSK).
- Ensure consistency, data quality, and a unified view across multiple data sources and formats.
Data Analysis & Insights
- Partner with business teams and data scientists to understand data requirements.
- Perform in-depth data analysis to identify trends, patterns, and anomalies.
- Deliver high-quality datasets and present actionable insights to stakeholders.
CI/CD & Automation
- Implement and maintain CI/CD pipelines using Jenkins or similar tools.
- Automate testing, deployment, and monitoring to ensure smooth production releases.
Data Security & Compliance
- Collaborate with security teams to ensure compliance with organizational and regulatory standards (e.g., GDPR, HIPAA).
- Implement data governance practices ensuring data integrity, security, and traceability.
Troubleshooting & Performance Tuning
- Identify and resolve performance bottlenecks in data pipelines.
- Apply best practices for monitoring, tuning, and optimizing data ingestion and storage.
Collaboration & Cross-Functional Work
- Work closely with engineers, data scientists, product managers, and business stakeholders.
- Participate in agile ceremonies, sprint planning, and architectural discussions.
Skills & Qualifications
Mandatory (Must-Have) Skills
- AWS Expertise
- Hands-on experience with AWS Big Data services such as EMR, Managed Apache Airflow, Glue, S3, DMS, MSK, and EC2.
- Strong understanding of cloud-native data architectures.
- Big Data Technologies
- Proficiency in PySpark or Scala Spark and SQL for large-scale data transformation and analysis.
- Experience with Apache Spark and Apache Kafka in production environments.
- Data Frameworks
- Strong knowledge of Spark DataFrames and Datasets.
- ETL Pipeline Development
- Proven experience in building scalable and reliable ETL pipelines for both batch and real-time data processing.
- Database Modeling & Data Warehousing
- Expertise in designing scalable data models for OLAP and OLTP systems.
- Data Analysis & Insights
- Ability to perform complex data analysis and extract actionable business insights.
- Strong analytical and problem-solving skills with a data-driven mindset.
- CI/CD & Automation
- Basic to intermediate experience with CI/CD pipelines using Jenkins or similar tools.
- Familiarity with automated testing and deployment workflows.
Good-to-Have (Preferred) Skills
- Knowledge of Java for data processing applications.
- Experience with NoSQL databases (e.g., DynamoDB, Cassandra, MongoDB).
- Familiarity with data governance frameworks and compliance tooling.
- Experience with monitoring and observability tools such as AWS CloudWatch, Splunk, or Dynatrace.
- Exposure to cost optimization strategies for large-scale cloud data platforms.
Skills: big data, scala spark, apache spark, ETL pipeline development
******
Notice period - 0 to 15 days only
Job stability is mandatory
Location: Hyderabad
Note: If a candidate is a short joiner, based in Hyderabad, and fits within the approved budget, we will proceed with an offer
F2F Interview: 14th Feb 2026
3 days in office, Hybrid model.

Similar jobs
- Candidate Must have Project management experience.
- Need Immediate joiner or candidate with upto 30 Days Notice period.
- Strong hands-on experience with SQL, including the ability to write, optimize, and debug complex queries (joins, CTEs, subqueries).
- Must have experienece in Treasury Module.
- Should have a basic understanding of accounting principles and financial workflows
- 3+ years of implementation experience is required.
- Looking candidates from Fintech company ONLY. ( Candidate should have Strong knowledge of fintech products, financial workflows, and integrations )
- Candidate should have Hands-on experience with tools such as Jira, Confluence, Excel, and project management platforms.
- Candidate should have Experience in managing multi-stakeholder projects from scratch.
- Need candidate from Bangalore, Hyderabad and Gurgaon ONLY.
Position: AEM Developer – Backend (Apple)
Locations: Hyderabad, Chennai, Bangalore, Bhubaneswar, Pune, Mumbai
- Interview Rounds: 2 Technical
- Notice Period: Immediate to 30 days
Experience Required
- 7–10 years total IT experience (Minimum 7+ years mandatory)
- 4+ years hands-on experience in AEM Backend
- 4+ years strong Java Core development experience
Key Skills & Responsibilities
- Strong Core Java (Collections, Exception Handling, Design Patterns, Multithreading)
- Hands-on experience with AEM 6.4+
- Expertise in Sling, OSGi, JCR, WCM APIs, Sling Models
- Strong knowledge of Workflows, Workflow Launchers, Event Handlers, Schedulers, Sling Jobs
- Experience in REST APIs, JSON, Lucene Indexing
- Knowledge of Sightly (HTL), Touch UI, Editable Templates, Clientlibs
- Exposure to Coral/Granite UI customization
- Experience with Query Builder, Indexing, Session Handling
- Strong understanding of AEM Security (ACL, SSO)
- Performance tuning: Dispatcher caching, query optimization
- Infrastructure setup: Dispatcher, Apache, Cronjobs
- Experience with TarMK, MongoMK, S3 persistence
- Build & Deployment using Maven, Jenkins, CI/CD
- Experience in AEM upgrades (Service Packs, Version Upgrade, Migration)
- Knowledge of Headless CMS, MSM, API integrations
- Exposure to Automated Testing tools (Junit, Selenium)
- Good understanding of DXP landscape
- Prior Apple project experience is a strong plus
- Installation of New PC, Laptops, Mobile Devices. Apple Mac will be an added advantage
- Manual and Automated methods of Installing and Troubleshooting of Windows 7, 8, 10,
- Installation of Android latest versions, Windows mobile Operating system. Mac will be an added advantage
- Installation/Updating drivers, windows software, License activation
- Hardware Troubleshooting and spare replacement on Desktops, Laptops mandatory ( Lenovo, HP, Dell )
- Installation and Troubleshooting of Wifi routers and Basic LAN Network.
- Installation and Troubleshooting of Printers, Scanners and All in one printers (USB/LAN)
- Fair knowledge on using remote support tools.
- Good communication skills written and verbal English.
- Understanding the service flow and process oriented.
Requirement
- Min. 1yr to 3yr experience. (Must have L1 technical knowledge of Desktop, Laptop, Network LAN, Wifi and printers)
- Ability to install, configure and troubleshoot Windows 7/8/10.
- Ability to install, configure and troubleshoot Android, Windows Mobile and Apple devices.
- Applications installation, troubleshoot software/LAN/WIFI issues.
- HW troubleshooting skills on desktops and laptops by using relevant diagnosis tools. (Lenovo, Dell and HP mandatory).
- Replacing spares for Desktop and Laptops. (Lenovo, Dell and HP mandatory mandatory).
- Candidate should be ready for end to end field support.
- Possess 2 wheeler with driving license is must.
- Flexible for travel out of the city if required.
- Knowledge on Windows Server, Active Directory, and O365 will be an added advantage.
- Education: Diploma/Graduation/Undergraduate.
- Should adhere and follow the process and flow laid down by the organisation.
- Good communication skills both written and verbal in English.
- Immediate joining preferred.
- Should have taken at least Covid Vaccination 1st dose.
Benefits
- 3 lakh rupees medical insurance
- 5 lakh rupees term insurance
- Opportunity to learn new skills and certifications
Job description
Day-to-day responsibilities include:
1. Understanding the product offerings and managing new deliverables
2. Working on product planning and its complete roadmap, including UI/UX
3. Collaborating with FynTune's stakeholders, including both the management and their clients who utilize FynTune's technology solutions, such as insurance companies, aggregators, and financial enterprises, to plan projects effectively
4. Working along with the QA team on product logic and product validations
5. Working along with the technology team on product development
6. Working with the project team & supporting them on product deliveries
7. Coordinating with stakeholders (internal & external) for the smooth delivery of the overall project
8. Understanding the requirements of clients on the project front and getting the deliveries from FynTune's technology and product team
Who can apply
Only those candidates can apply who:
1. are available for fulltime (in-office)
2. who are graduates and freshers.
3. Should have relevant skills and interests.
Role: Product Manager
Industry Type: IT Services & Consulting
Department: Product Management
Employment Type: Full Time, Permanent
Role Category: Product Management - Technology
Education
UG: Any Graduate
What you will do:
- Improving business processes across customer service and operations functions
- Working in partnership with business stakeholders providing process excellence expertise to identify and shape opportunities that drive improved customer experience
- Working closely with business to embed continuous improvement as a culture and support the delivery of outcomes in conjunction with project implementation stakeholders
- Increasing process transparency to identify process optimization opportunities with lean/Six sigma methodologies and tools
- Being a voice for our customer experience team by identifying escalatory queries, operational inefficiency, providing customer insights and collaborating with cross-functional teams to provide solutions for those customers
- Collaborating with other departments to resolve complicated issues and issues which require special attention
- Analysing customer care / operations team data and statistics to obtain results useful in taking key business decisions
- Contributing to the development of industry-leading processes and best practices for delivering customer excellence
Desired Candidate Profile
What you need to have:- MBA/ PGDM from Tier 1 college
- Certifications in Six Sigma/ PMP/ ITIL will be an added advantage
- Focus on quality and excellent problem solving and conflict resolution skills
- Knowledge in OKR, Agile Tools: Jira, CRM (Zoho, OneDirect etc.), Power BI
- Exceptional communication and presentation skills
- Minimum 5 years of experience in Process/ Business Excellence and process automation across BFSI/ Fintech domain
- Experience in streamlining and automation of inbound and outbound communication channels
- Experience in leading a process excellence function with a team of passionate individuals to deliver measurable results
Our client is an Indian brand that competes with global giants in the space of smartphone accessories such as smart watches, wireless earbuds, bluetooth earphone, headphones, speakers and accessories for young Indian consumers.
Founded in 2014 and headquartered in Gurgaon, our client makes the latest personal technology accessories available and affordable.
They have been listed as best selling brand on Amazon and Flipkart for four years in a row and in 2019, they were the biggest Indian seller of wireless earphones in the country. Also, among the top 5 brands selling wireless earphones in India, they were the only Indian brand.
As a TA Manager, you will be responsible for designing the hiring process, and implementing best practices to ensure optimal results.
What you will do:
- Working closely with team leads to understand hiring requirements, and deciding the best approach & strategy for each hire
- Working on the AOP and plan for manpower optimally with the functional heads and the management
- Catering to all recruitment requirements of the business and smooth closing of hiring process within TAT & optimized source mix
- Working closely with management, planning strategies for recruitment and end-to-end hiring process
- Effectively using job portals such as LinkedIn, Facebook, various job posts on portals, IIMjobs and implementing Employee Referral Schemes
- Managing vendors for planning leadership hiring, recruitment drives and specialized recruitment process
- Preparing, managing and delivering various recruitment reports, analysis and dashboard on a periodic basis
- Carrying out the offer-making process and negotiating with the candidates on C&B
- Ensuring all offered candidates join and within the agreed timelines
Desired Candidate Profile
What you need to have:- MBA in HR
- 5-7 years relevant work experience in TA in a fast paced organization
- Excellent communication skills
- Ability to be comfortable with a high volume workload and not be afraid to "roll up your sleeves"
- Ability to identify problems and drive appropriate solutions
- Strong management skills
- Ability to manage multiple priorities simultaneously
- Excellent organizational and interpersonal skills
We are creating one of the strongest tech companies and are working extensively on cutting edge technologies.
Clojure Kotlin Scala R F# Node.js React Native ML Kafka Apache Spark DevOps React Vue.js
What We Look For
Bring in a "can-do" attitude.
Passion towards technology and software engineering - blogging, open-source, pet projects, conference talks
Participate in a highly fluid environment applying agile software development principles
Carry out unit tests and other quality control mechanisms to inform and validate the designs and code
Work with customers to bring an end to end perspective of the problem
Ability to ask the right questions and communicate your ideas with clarity
Ability to collaborate with various stakeholders and take complete ownership
Participate actively in building one of the strongest technology organizations.
As a Software Engineer :
Quickly adapt to our startup environment which is both demanding and fast-paced (but is also a lot of fun)
Eager in learning new concepts, technologies and be productive in a short time
Convert a raw idea into usable real-life software products
Good understanding and working knowledge of technologies worked
Demonstrate good problem-solving skills
Write modular, readable, and maintainable code
Own and be able to manage a small to medium-sized project
Demonstrate the ability to guide and coach a new team member or fresher.
Position: Dot Net Developer
Company : Mobile Programming
Duration: Full time role
Shift : Noon
Experience Required : 4.5+ years
Job Location : Mohali/Gurgaon
Notice Period : Immediate to 15 Days (only).
Job Description:
C#/.NET developers with WPF(must) and web Api
must be from a windows background.
https://www.google.com/url?q=http://ASP.Net&sa=D&source=hangouts&ust=1593837195213000&usg=AFQjCNGT04NuieW8LSZhtHl_lBhagE49EQ" target="_blank">Please your relevant experience in the below mentioned skill set-
https://www.google.com/url?q=http://ASP.Net&sa=D&source=hangouts&ust=1593837195213000&usg=AFQjCNGT04NuieW8LSZhtHl_lBhagE49EQ" target="_blank">ASP.Net, C#, Web API :
MVVM/WPF:









