Lead II - SE - AWS, Apache Spark (PySpark/Scala), Apache Kafka
at Global digital transformation solutions provider.
Amazon Web Services (AWS)
Scala
Jenkins
Data Analytics
Data Science
Java
MongoDBJOB DETAILS:
* Job Title: Lead II - Software Engineering - AWS, Apache Spark (PySpark/Scala), Apache Kafka
* Industry: Global digital transformation solutions provider
* Salary: Best in Industry
* Experience: 5-8 years
* Location: Hyderabad
Job Summary
We are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The role involves working with large-scale batch and real-time data processing systems, collaborating with cross-functional teams, and ensuring data reliability, security, and performance across the data lifecycle.
Key Responsibilities
ETL Pipeline Development & Optimization
- Design, develop, and maintain complex end-to-end ETL pipelines for large-scale data ingestion and processing.
- Optimize data pipelines for performance, scalability, fault tolerance, and reliability.
Big Data Processing
- Develop and optimize batch and real-time data processing solutions using Apache Spark (PySpark/Scala) and Apache Kafka.
- Ensure fault-tolerant, scalable, and high-performance data processing systems.
Cloud Infrastructure Development
- Build and manage scalable, cloud-native data infrastructure on AWS.
- Design resilient and cost-efficient data pipelines adaptable to varying data volume and formats.
Real-Time & Batch Data Integration
- Enable seamless ingestion and processing of real-time streaming and batch data sources (e.g., AWS MSK).
- Ensure consistency, data quality, and a unified view across multiple data sources and formats.
Data Analysis & Insights
- Partner with business teams and data scientists to understand data requirements.
- Perform in-depth data analysis to identify trends, patterns, and anomalies.
- Deliver high-quality datasets and present actionable insights to stakeholders.
CI/CD & Automation
- Implement and maintain CI/CD pipelines using Jenkins or similar tools.
- Automate testing, deployment, and monitoring to ensure smooth production releases.
Data Security & Compliance
- Collaborate with security teams to ensure compliance with organizational and regulatory standards (e.g., GDPR, HIPAA).
- Implement data governance practices ensuring data integrity, security, and traceability.
Troubleshooting & Performance Tuning
- Identify and resolve performance bottlenecks in data pipelines.
- Apply best practices for monitoring, tuning, and optimizing data ingestion and storage.
Collaboration & Cross-Functional Work
- Work closely with engineers, data scientists, product managers, and business stakeholders.
- Participate in agile ceremonies, sprint planning, and architectural discussions.
Skills & Qualifications
Mandatory (Must-Have) Skills
- AWS Expertise
- Hands-on experience with AWS Big Data services such as EMR, Managed Apache Airflow, Glue, S3, DMS, MSK, and EC2.
- Strong understanding of cloud-native data architectures.
- Big Data Technologies
- Proficiency in PySpark or Scala Spark and SQL for large-scale data transformation and analysis.
- Experience with Apache Spark and Apache Kafka in production environments.
- Data Frameworks
- Strong knowledge of Spark DataFrames and Datasets.
- ETL Pipeline Development
- Proven experience in building scalable and reliable ETL pipelines for both batch and real-time data processing.
- Database Modeling & Data Warehousing
- Expertise in designing scalable data models for OLAP and OLTP systems.
- Data Analysis & Insights
- Ability to perform complex data analysis and extract actionable business insights.
- Strong analytical and problem-solving skills with a data-driven mindset.
- CI/CD & Automation
- Basic to intermediate experience with CI/CD pipelines using Jenkins or similar tools.
- Familiarity with automated testing and deployment workflows.
Good-to-Have (Preferred) Skills
- Knowledge of Java for data processing applications.
- Experience with NoSQL databases (e.g., DynamoDB, Cassandra, MongoDB).
- Familiarity with data governance frameworks and compliance tooling.
- Experience with monitoring and observability tools such as AWS CloudWatch, Splunk, or Dynatrace.
- Exposure to cost optimization strategies for large-scale cloud data platforms.
Skills: big data, scala spark, apache spark, ETL pipeline development
******
Notice period - 0 to 15 days only
Job stability is mandatory
Location: Hyderabad
Note: If a candidate is a short joiner, based in Hyderabad, and fits within the approved budget, we will proceed with an offer
F2F Interview: 14th Feb 2026
3 days in office, Hybrid model.
Shubham Vishwakarma
Full Stack Developer - Averlon
Similar jobs
Hello Candidate,
Hope you're doing well!
We have an exciting opening for the Field Sales Executive role at Miror, offering strong growth potential and a dynamic work environment.
If you're interested or know someone who might be, feel free to reach via job posting
Looking forward to connecting!
About Miror
Miror is India’s leading FemTech platform transforming how women experience peri-menopause and menopause. In just a year, we’ve built India’s largest menopause-focused WhatsApp community, partnered with the National Health Mission and the Indian Menopause Society, and launched category-defining nutraceutical products and digital health services. Our app blends science and technology—offering personalized care pathways, symptom tracking, diagnostic links, games, AI-powered chat, expert consultations, and more. We're proud recipients of the Innovation in Menopause Care award at the Global Women’s Health Innovation Conference 2024 and are rapidly scaling toward our $1B+ vision. Learn more: miror.in
Job Description:
Field Sales Executive
Experience Required:
· Minimum 2 years in relevant industry (FemTech, Healthcare, Wellness, Pharma required)
Key Responsibilities:-
· Conduct direct field sales and product demos to potential customers.- Visit clinics, pharmacies, wellness centres, and residential areas as per assigned territory
· Achieve monthly sales targets and growth KPIs.
· Build and maintain strong customer relationships.
· Collect market intelligence and customer feedback to improve sales strategies
· Submit daily/weekly reports to the Sales Manager
· Ensure proper product placement and branding visibility.
Requirements
· Minimum 2 years of field sales experience in relevant industries (FemTech, HealthTech, Wellness, Pharma)
· Excellent communication and interpersonal skills.
· Self-motivated and target-driven.- Must own a personal two-wheeler with a valid driving license.- Comfortable with daily field visits and travel across assigned locations
· Basic understanding of digital tools like WhatsApp, Excel, or CRM apps is a plus.
Perks & Benefits
· Competitive salary + incentives
· Fuel allowance
· Performance-based growth opportunities
· Training and product knowledge support
Java
Spring BootRole & responsibilities
- Design, develop, test, and deploy high-quality Java applications.
- Collaborate with cross-functional teams to define, design, and ship new features.
- Write well-designed, testable, and efficient code using best practices.
- Troubleshoot production issues and provide timely solutions.
- Work with databases, APIs, and third-party services.
- Ensure security and performance of applications.
- Participate in Agile/Scrum processes, including sprint planning and stand-ups.
Required Skills & Qualifications:
- Strong proficiency in Core Java, OOPs, and Java 8+ features.
- Experience with Spring Framework (Spring Boot, MVC, Security, etc.).
- Excellent debugging and problem-solving skills
- Familiarity with RESTful APIs and Microservices Architecture.
- Experience with JPA/Hibernate and SQL/NoSQL databases.
- Knowledge of Maven/Gradle, Git, and CI/CD pipelines.
- Exposure to cloud platforms (AWS, Azure, GCP) is a plus.
- Familiar with unit testing frameworks (JUnit, Mockito, etc.).
- Understanding of design patterns and software engineering principles.
- Bachelor's degree in computer science or related field.
Preferred candidate profile
- Frontend experience with Angular/React.
- Exposure to containerization (Docker, Kubernetes).
- Experience in performance tuning or profiling Java applications.
- Familiarity with message brokers (Kafka, RabbitMQ).
Javascript
HTML/CSSResponsibilities:
- Independent team member for analyzing requirements, designing, coding, and implementing our client's Conversation AI products.
- As our clients product expert work closely with IT Managers and Business Groups to gather requirements and translate those into the required technical solution.
- Drive solution implementation using the Conversational design approach.
- Develop, deploy and maintain customized extensions to the Avaamo platform-specific to customer requirements.
- Conduct training and technical guidance sessions for partner and customer development teams.
- Evaluating reported defects and the correction of prioritized defects.
- Travel onsite to customer locations for close support.
- Document how to's and implement best practices for Avaamo product solutions.
Requirements:
- Strong programming experience in javascript, HTML/CSS.
- Experience of creating and consuming REST APIs and SOAP services.
- Strong knowledge and awareness of Web Technologies and current web trends.
- Working knowledge of Security in Web applications and services.
- experience in using the NodeJS framework with good understanding of the underlying architecture.
- Experience of deploying web applications on Linux servers in production environment.
- Excellent communication skills.
Good to haves:
- Full stack experience UI and UX design experience or insights
- Working knowledge of AI, ML and NLP.
- Experience of enterprise systems integration like MS Dynamics CRM, Salesforce, ServiceNow, MS Active Directory etc.
- Experience of building Single Sign On in web/mobile applications.
- Ability to learn latest technologies and handle small engineering teams.
Vue.js
AngularJS (1.x)
Angular (2+)
React.jsJavascript- 2 to 5 years of experience (or equivalent understanding of software engineering)
- Familiar with one backend language (Node, Go, Java, Python)
- Familiar with Javascript/Typescript and a UI framework
- Willingness and interest in learning new tech/processes (Airflow, AWS, IaaS, etc.)
Job Description
We are looking for a reliable Administration Executive. He will undertake administrative tasks, ensuring the rest of the staff has adequate support to work efficiently. The ideal candidate will be competent in prioritizing and working with little supervision. The administration executive will ensure smooth running of our company’s office.
Key Responsibilities:
- Admin & daily office facility work
- Ordering Office supplies (stationery, pantry and other inventory)
- Maintenance & repair of Assets/Laptops
- Bills & payment records.
- Supervision & Staffing of the office.
- Tracking budget expenses.
Desired Candidate Profile:
- Good verbal and written communication skills.
- Technical bent of mind to isolate a problem quickly.
- Have proven experience in the same domain.
- Proficient with Microsoft Office, Excel software and phone systems.
Education-
Education: Any Graduate
• Working alongside managers and clients to agree their IT requirements.
• Identifying the hardware and software requirements in the organization.
• Explaining plans agreed with managers todesigners and developers
• Organising the workloads of the technical teams in the most efficient way
• Monitoring progress of the project and ensuring it's completed on time
• Reporting progress back to managers and clients
• Carrying out some of the technical work, depending on the level of
seniority
• Checking IT systems work as intended
• Advising and suggesting future IT developments to managers or clients.
Soft Skills Required:
• Anticipating and solving problems - a key part of the role is seeing where problems might arise during an IT project and finding solutions before, they go 'live' and disrupt the organisation.
• Communication skills - Need to be adept at listening to, understanding and explaining concepts to both managerial and technical colleagues.
• Dealing with pressure - technical architects have a lot of responsibility and he/she have to be able to deliver results in high-pressure circumstances.
• Prioritisation and time management - IT projects often have
tight deadlines and missing them can have significant consequences for the organisation or client.
• Relationship-building - it's important to develop trust and understanding between the technical teams and managers or clients to ensure a project runs smoothly
What you will do:
- Researching possible business opportunities, prospecting new clients through various sources and building a pipeline of prospects
- Reaching out to potential clients via cold calls and cold email
- Understanding the business requirements of the clients and accordingly pitching the company’s products/services
- Educating the new clients and also updating the existing clients about any product/service improvements/updates
- Answering any concerns or queries raised by the clients in a timely manner
- Following up with the clients to ensure that their show of interest is retained and converted to business for the company
- Negotiating and closing the sales deal by handling all the relevant operational activities as well during the process
- Collecting feedback and suggestions from the clients in regular intervals and reporting the same to the management
- Ensuring compliance of relevant rules, laws & regulations
- Updating and maintaining a database of prospects, sales figures etc. and reporting the same to the management in regular intervals
- Working in coordination with internal stakeholders such as various teams and external stakeholders such as clients
Desired Candidate Profile
What you need to have:- Graduation is a must
- Relevant work experience of minimum 2+ years in inside sales
- Previous experience of handling a CRM, using an email outreach tool and prospecting is required
- Willingness to work remotely
- Excellent communication skills- Advanced level proficiency in English is required
- Excellent negotiation and presentation skills
JOB DESCRIPTION
- Initiate New campaigns across various channels.
- Launch and optimization of PPC Campaigns.
- Overseeing Accounts related to Search platforms as well as inspecting Budgets.
- Providing necessary reports and monitoring KPIs.
- Have the highest possible Return of Investments towards Online Marketing Efforts.
Other important responsibilities include –
- Managing Large Keyword list creation.
- Formation of Effective and optimum paid strategies.
- Launching of numerous PPC campaigns Monitoring accounts related to Search engine Platforms (Google AdWords, Bing etc) Rightful Targeting of the required Audiences.
- Timely working on Budgets and Bids towards gaining better Return of Investments (ROIs) Generate attractive and concise advert copies.
- Maintain and Coordinate Partnerships with Vendors and PPC Ad Platforms. Enhance and adapt Modern trends related to SEM and PPC
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon