
Lead II - SE - AWS, Apache Spark (PySpark/Scala), Apache Kafka
at Global digital transformation solutions provider.
JOB DETAILS:
* Job Title: Lead II - Software Engineering - AWS, Apache Spark (PySpark/Scala), Apache Kafka
* Industry: Global digital transformation solutions provider
* Salary: Best in Industry
* Experience: 5-8 years
* Location: Hyderabad
Job Summary
We are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The role involves working with large-scale batch and real-time data processing systems, collaborating with cross-functional teams, and ensuring data reliability, security, and performance across the data lifecycle.
Key Responsibilities
ETL Pipeline Development & Optimization
- Design, develop, and maintain complex end-to-end ETL pipelines for large-scale data ingestion and processing.
- Optimize data pipelines for performance, scalability, fault tolerance, and reliability.
Big Data Processing
- Develop and optimize batch and real-time data processing solutions using Apache Spark (PySpark/Scala) and Apache Kafka.
- Ensure fault-tolerant, scalable, and high-performance data processing systems.
Cloud Infrastructure Development
- Build and manage scalable, cloud-native data infrastructure on AWS.
- Design resilient and cost-efficient data pipelines adaptable to varying data volume and formats.
Real-Time & Batch Data Integration
- Enable seamless ingestion and processing of real-time streaming and batch data sources (e.g., AWS MSK).
- Ensure consistency, data quality, and a unified view across multiple data sources and formats.
Data Analysis & Insights
- Partner with business teams and data scientists to understand data requirements.
- Perform in-depth data analysis to identify trends, patterns, and anomalies.
- Deliver high-quality datasets and present actionable insights to stakeholders.
CI/CD & Automation
- Implement and maintain CI/CD pipelines using Jenkins or similar tools.
- Automate testing, deployment, and monitoring to ensure smooth production releases.
Data Security & Compliance
- Collaborate with security teams to ensure compliance with organizational and regulatory standards (e.g., GDPR, HIPAA).
- Implement data governance practices ensuring data integrity, security, and traceability.
Troubleshooting & Performance Tuning
- Identify and resolve performance bottlenecks in data pipelines.
- Apply best practices for monitoring, tuning, and optimizing data ingestion and storage.
Collaboration & Cross-Functional Work
- Work closely with engineers, data scientists, product managers, and business stakeholders.
- Participate in agile ceremonies, sprint planning, and architectural discussions.
Skills & Qualifications
Mandatory (Must-Have) Skills
- AWS Expertise
- Hands-on experience with AWS Big Data services such as EMR, Managed Apache Airflow, Glue, S3, DMS, MSK, and EC2.
- Strong understanding of cloud-native data architectures.
- Big Data Technologies
- Proficiency in PySpark or Scala Spark and SQL for large-scale data transformation and analysis.
- Experience with Apache Spark and Apache Kafka in production environments.
- Data Frameworks
- Strong knowledge of Spark DataFrames and Datasets.
- ETL Pipeline Development
- Proven experience in building scalable and reliable ETL pipelines for both batch and real-time data processing.
- Database Modeling & Data Warehousing
- Expertise in designing scalable data models for OLAP and OLTP systems.
- Data Analysis & Insights
- Ability to perform complex data analysis and extract actionable business insights.
- Strong analytical and problem-solving skills with a data-driven mindset.
- CI/CD & Automation
- Basic to intermediate experience with CI/CD pipelines using Jenkins or similar tools.
- Familiarity with automated testing and deployment workflows.
Good-to-Have (Preferred) Skills
- Knowledge of Java for data processing applications.
- Experience with NoSQL databases (e.g., DynamoDB, Cassandra, MongoDB).
- Familiarity with data governance frameworks and compliance tooling.
- Experience with monitoring and observability tools such as AWS CloudWatch, Splunk, or Dynatrace.
- Exposure to cost optimization strategies for large-scale cloud data platforms.
Skills: big data, scala spark, apache spark, ETL pipeline development
******
Notice period - 0 to 15 days only
Job stability is mandatory
Location: Hyderabad
Note: If a candidate is a short joiner, based in Hyderabad, and fits within the approved budget, we will proceed with an offer
F2F Interview: 14th Feb 2026
3 days in office, Hybrid model.

Similar jobs

Company Overview:
Euphoric Thought Technologies is a dynamic and innovative technology company specializing in providing cutting-edge automation solutions for businesses across various sectors. We empower organizations to streamline their processes, enhance efficiency, and achieve significant cost savings through intelligent automation strategies. Our expertise spans across diverse platforms, enabling us to deliver tailored solutions that meet the unique needs of our clients.
Role Overview:
As a Python Automation Developer at Euphoric Thought Technologies, you will be instrumental in designing, developing, and implementing robust automation frameworks and scripts to ensure the quality and reliability of our software solutions. You will collaborate closely with development, QA, and DevOps teams to identify automation opportunities, build efficient test suites, and contribute to continuous integration and continuous delivery (CI/CD) pipelines. Your work will directly impact the speed and quality of our software releases, enabling us to deliver exceptional value to our customers.
Key Responsibilities:
- Design and develop automation frameworks using Python to validate .Net and C# based applications.
- Create and maintain automated test scripts for REST APIs, focusing on JSON data validation.
- Integrate automated tests into CI/CD pipelines using Azure DevOps to ensure continuous testing.
- Collaborate with developers and QA engineers to identify and resolve defects, improving overall software quality.
- Analyze test results and generate comprehensive reports to communicate testing progress and identify areas for improvement.
- Contribute to the development of automation best practices and standards to enhance team efficiency.
- Maintain and enhance existing automation frameworks to adapt to evolving project requirements.
- Participate in code reviews to ensure code quality and adherence to coding standards.
Required Skillset:
- Demonstrated proficiency in Python programming for automation, including experience with relevant libraries and frameworks.
- Solid understanding of software testing principles and methodologies, with experience in developing and executing automated test cases.
- Experience with REST API testing and JSON data validation.
- Familiarity with .Net and C# development environments.
- Experience with Azure DevOps for CI/CD and test automation.
- Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex technical issues.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
- Bachelor's degree in Computer Science or a related field.
Account-Based Marketing (ABM) Manager
Location: Noida (Work from Office)
About the Role
We are looking for a highly strategic and execution-focused Account-Based Marketing (ABM) Manager to drive targeted growth across high-value enterprise accounts. This role sits at the intersection of marketing and sales, owning personalized campaigns that directly impact pipeline and revenue.
You will work closely with Sales, Product Marketing, and Demand Generation teams to design and execute tailored outreach strategies for key accounts globally.
Key Responsibilities
- ABM Strategy & Execution Design and execute account-based marketing programs for targeted enterprise accounts
- Identify and prioritize high-value accounts in collaboration with sales teams
- Campaign ManagementPlan and run multi-channel campaigns (email, LinkedIn, events, content syndication)
- Drive personalized messaging tailored to specific accounts, industries, and personas
- Sales AlignmentPartner closely with Account Executives and SDRs to align on account plans and outreach
- Enable sales teams with insights, messaging, and campaign support
- Data & InsightsLeverage intent data, CRM insights, and marketing automation tools to refine targeting
- Track, measure, and optimize campaign performance and ROI
- Content & PersonalizationWork with content and product marketing teams to create account-specific assets
- Develop use-case driven narratives for enterprise buyers (CTOs, QA Heads, Engineering Leaders)
- Pipeline ContributionOwn ABM-driven pipeline generation and influence revenue outcomes
- Continuously experiment and improve conversion across the funnel
Requirements
- 3–7 years of experience in B2B Marketing / Demand Generation / ABM
- Strong understanding of SaaS, enterprise sales cycles, and developer tools ecosystem (preferred)
- Proven experience in running targeted campaigns for enterprise accounts
- Hands-on experience with tools like HubSpot, Salesforce, Marketo, Outreach, LinkedIn Campaign Manager, Demandbase (good to have)
- Strong analytical mindset with ability to translate data into actionable insights
- Excellent communication and stakeholder management skills
What We’re Looking For
- Strategic thinker with a revenue-first mindset
- High ownership and ability to operate in a fast-paced, high-growth environment
- Strong collaboration skills across sales, marketing, and product teams
- Creative approach to personalization and engagement for linkedin messages/ Leads account based messages + timeline post
Product Management Internship – NeuraMach.AI
Location: Pune (Onsite) | Stipend: 0 – ₹15K/month | Duration: 3-6 months | Start: Immediate
About NeuraMach.AI
NeuraMach.AI is an AI-first technology company building adaptive systems using AI, ML, VR, and web/mobile development. Our mission is to transform how individuals engage with digital experiences—leveraging research-driven design, intelligent automation, and personalized interactions. Backed by professionals from top institutions, we are building next-gen tools that drive innovation and creativity.
We’re looking for a motivated Product Management Intern to join our Pune team. This is a full-time internship (3–6 months) with the potential for a full-time offer.
What you’ll do
Don multiple hats — work as a product intern, founders’ office associate, and problem-solver across teams.
Support product strategy, roadmap & execution.
Conduct market research, competitor mapping, and user analysis.
Collaborate with AI/ML/VR engineers for smooth development.
Define KPIs, draft feature specs & write user stories.
Assist in product launches & GTM execution.
Analyze user engagement data to propose improvements.
What we’re looking for
Students/recent grads in Business, CS, Engineering (or related).
Strong analytical mindset with a passion for AI-driven products.
Excellent communication & collaboration skills.
Bonus: exposure to Agile, UX, or wireframing tools
What you’ll gain
Direct experience building production-level AI systems.
1:1 mentorship from experienced AI professionals.
Opportunity to contribute to internal research & prototyping.
Flexible work culture, meaningful projects, and real ownership.
Certificate of completion + high chance of full-time placement.
Roles and Responsibilities
- Calling people who have filled the signup or contact form
- Finding leads online/offline who match the criteria of the target customer
- Make cold calls to the leads generated
- Handle both outbound/inbound calls
- Update systems, CRMs, Excels, Google Sheets
- Give platform demo to interested customers
- Write articles/knowledge base for tutorials on how to use the product
- Support customers for any queries about the product
Desired Candidate Profile
- Should have great convincing skills
- Should have strong negotiating skills
- Should be able to pitch the client understand the customer instead of repeating a fixed sales pitch
- Should have always achieved targets or beyond
- Should be able to Tech Savvy
- Go-getter attitude, self-starter, instead of manager or management having to follow up to get work done or to remind about targets
- Well organized with handling data, sales funnel and reaching out to the customers on time
- Soft-spoken and delight for customers to speak to
- Must have email writing skills to follow up or share information
- Can be on phone for a long time and familiar with using dialer systems
About our Client
Our client is a B2B2C tech firm backed by India’s largest retailer and tech venture capitalist founded by founders - IITB Graduates who are experienced in retail, ecommerce and fintech
It aims to become one app to manage all your brands loyalty points, cashback and coupons. It will have additional content and discovery layer for customers and brands for further engagement and commerce.
The company currently powers closed-loop loyalty programs for all different brands under its parent retail group. Currently, it has 20Mn+ registered customers and 3Mn MAU across 8 brands. Its vision is to be at the center of D2C Brands and the consumer consumption ecosystem
Responsibilities and Duties
- Develop React Native and Android Mobile Applications from design
- Can analyse requirements and communicate with clients
- Must have proficiency in communication
- Should have knowledge of Core Android, Java, Kotlin, React Native, MySQL, SQLite, MVVM, MVP and MVC.
- Work on bug fixes and improvement of Mobile applications.
- Preferred to have knowledge in React Native and Android both.
Required Experience, Skills and Qualifications
- 3 + years of experience in Android development.
- Minimum 1 Year experience in React Native development.
- BE/MS/MCA/PGDCA degree in Computer Science, Engineering or a related subject.
- Have worked on ReactJS Projects
Regards
Team Merito
- MS exchange: 4-5 Years of experience in Version upgrade and migration, Designing, Troubleshooting
- Azure: 3-4 years of experience in Designing, Maintenance, and Advanced utilization
- AD, DNS, DHCP: 4-5 Years of experience in Version upgrade, maintenance and advanced troubleshooting, PCI compliance experience
- SCCM: 2-3 years of experience in OS build and deployment, Patch management
- JAMF: 2-3 years of experience in App deployment and patch management
Description:
Are you curious, persistent, logical and clever – a true 'Techie' at heart? …..
Do you enjoy living by the code of your craft and developing elegant solutions for complex problems? ........
If this sounds like you, this could be the perfect opportunity to join BuzzBoard as an Angular Developer. Scroll down to learn more about the position’s responsibilities and requirements.
We are looking for an Angular Developer to join our awesome team and deliver a streamlined user experience. We want a team member who strives to develop first class codebase using Angular best practices. As an Angular Developer, you will develop the next generation user interface for our web applications.
Who We Are:
Headquartered in San Francisco, BuzzBoard is a leader in the data knowledge platform. We help media and tech companies across the globe to grow their businesses. We provide data, insights and recommendations to B2SMB companies to help them deeply understand their customers and build trusted relationships.
BuzzBoard is a powerful tool to help businesses drive more sales through deeper, more personalized engagement with their customers and leads.
We align our hiring practices with our core values that include:
- We are passionate for hard work, desire to succeed and have fun in the process
- We put our reputation first, always
- We relish and fuel the entrepreneurial spirit in everyone
- We believe company growth ties us to our collective future
- We are first to respond to customer and team member needs
Responsibilities:
- Work cross-functionally and collaboratively to develop an application using open source technologies.
- Create single page applications using HTML, Angular, node.js and javascript, based on user stories with documented acceptance criteria.
- Troubleshoot issues and create code fixes for open source products.
- Address defects and collaboratively work with functional and technical teams to integrate applications in cloud environment.
- Work in a fast-paced, agile environment consisting of a cross-functional team designing and implementing systems from the web-based user interface front-end through the back-end.
Requirements
- Strong Knowledge on Javascript.Strong Knowledge on Angular 2, Angular 5 and above
- Communicating with external web services.
- Cooperating with the back-end developer in the process of building the RESTFUL API.
- Execute unit test cases in Angular frameworks.
- Good Knowledge on HTML, CSS.
- Good Understanding on OOPS.
- Good debugging skills required and able to understand existing code and logic.
- Having knowledge on Jquery and Nodejs is added advantage.
- Should be interested in R&D’s and integrations.
- Knowledge on PHP will be an added advantage
- Good communication skills, learning knowledge and analytical capabilities.
Benefits
Corporate Health Insurance, Tax optimization, Earned Leaves, Wellness activities and Fun filled culture

Hi dear Applicant,
Hiring for Multiple MNC Bpo’s, One day interview process, just 2 rounds of interview
Openings :
Customer Support : Voice & Non-voice
-
Health Care
-
Accounts Receivable
-
Medical Billing
-
Insurance
-
Banking / collections
-
Accounts & Finance
Technical Support : Voice & Non-voice
-
Technical Trouble Shooting
-
Hardware and Networking
-
IT Help Desk
-
Desktop Support
-
Technical Chat / Email Support
-
Application Support (Voice)
-
IT Trouble Shooting
Benefits :
-
Day / UK / US Rotational Shifts
-
15k to 35K Take home
-
Two way Transport
-
Unlimited incentive Structure
-
No registration Fees
Skills Required :
-
Should be flexible with rotational Shifts
-
Manageable or Good English Communication Skills
-
Graduates / PUC / Diploma fresher or Experience in BPO (0-8yrs) can apply
-
Candidates with Graduation Backlogs can apply.
Documents Required :
Fresher :
-
10th / 12th / Graduation all semester Marks card
-
Aadhar Card ID proof
-
Pan Cad ID
Experience :
-
Previous Companies Offer letter / relieving letter / one month pay slips
-
10th / 12th / Graduation all semester Marks card
-
Aadhar Card ID proof
-
Pan Cad ID
*************PLEASE DO REFER YOUR FRIENDS*************
Required Skills and Experience
- 4+ years of relevant experience with DevOps tools Jenkins, Ansible, Chef etc
- 4+ years of experience in continuous integration/deployment and software tools development experience with Python and shell scripts etc
- Building and running Docker images and deployment on Amazon ECS
- Working with AWS services (EC2, S3, ELB, VPC, RDS, Cloudwatch, ECS, ECR, EKS)
- Knowledge and experience working with container technologies such as Docker and Amazon ECS, EKS, Kubernetes
- Experience with source code and configuration management tools such as Git, Bitbucket, and Maven
- Ability to work with and support Linux environments (Ubuntu, Amazon Linux, CentOS)
- Knowledge and experience in cloud orchestration tools such as AWS Cloudformation/Terraform etc
- Experience with implementing "infrastructure as code", “pipeline as code” and "security as code" to enable continuous integration and delivery
- Understanding of IAM, RBAC, NACLs, and KMS
- Good communication skills
Good to have:
- Strong understanding of security concepts, methodologies and apply them such as SSH, public key encryption, access credentials, certificates etc.
- Knowledge of database administration such as MongoDB.
- Knowledge of maintaining and using tools such as Jira, Bitbucket, Confluence.
- Work with Leads and Architects in designing and implementation of technical infrastructure, platform, and tools to support modern best practices and facilitate the efficiency of our development teams through automation, CI/CD pipelines, and ease of access and performance.
- Establish and promote DevOps thinking, guidelines, best practices, and standards.
- Contribute to architectural discussions, Agile software development process improvement, and DevOps best practices.







