11+ Apache Flume Jobs in Hyderabad | Apache Flume Job openings in Hyderabad

Lead Cloud Reliability Engineer

Job Responsibilities

● Lead and manage the Cloud Reliability teams to provide strong Managed Services support to end-customers.

● Isolate, troubleshoot and resolve issues reported by CMS clients in their cloud environment

● Drive the communication with the customer providing details about the issue, current steps, next plan of action, ETA

● Gather client's requirements related to use of specic cloud services and provide assistance in seing them up and resolving issues

● Create SOPs and knowledge articles for use by the L1 teams to resolve common issues

● Identify recurring issues, perform root cause analysis and propose/implement preventive actions

● Follow change management procedure to identify, record and implement changes

● Plan and deploy OS, security patches in Windows/Linux environment and upgrade k8s clusters

● Identify the recurring manual activities and contribute to automation

● Provide technical guidance and educate team members on development and operations. Monitor metrics and develop ways to improve.

● System troubleshooting and problem-solving across plaorm and application domains. Ability to use a wide variety of open-source technologies and cloud services.

● Build, maintain, and monitor conguration standards.

● Ensuring critical system security through using best-in-class cloud security solutions.

Qualifications

● 4-7 years experience in Cloud Infrastructure and Operations domains and IT operational experience preferably in a global enterprise environment.

● Specialize in one or two cloud deployment platforms: AWS, GCP

● Hands on experience with AWS/GCP services (EKS, ECS, EC2, VPC, RDS, Lambda, GKE, Compute Engine)

● Understanding of one or more programming languages (Python, JavaScript, Ruby, Java, .Net)

● Logging and Monitoring tools (ELK, Stackdriver, CloudWatch)

● Knowledge on Conguration Management tools such as Ansible, Terraform, Puppet, Chef

● Experience working with deployment and orchestration technologies (such as Docker, Kubernetes, Mesos)

● Good analytical, communication, problem solving, and learning skills.

● Knowledge on programming against cloud plaorms such as Google Cloud Platform and lean development methodologies.

● Strong service aitude and a commitment to quality.

● Willingness to work in shifts.

• Qualifications and SkillsProven experience in technical recruiting with a strong background in the IT industry.
• Ability to effectively source candidates using various channels, including online and offline platforms.
• Strong expertise in talent sourcing (Mandatory skill).
• Proficiency in screening and evaluating candidates' skills, experience, and qualifications (Mandatory skill).
• Excellent knowledge of Applicant Tracking Systems (ATS) and their management (Mandatory skill).
• Strong communication and interpersonal skills to maintain professional relationships with candidates and colleagues.
• A keen understanding of industry market trends and the competitive landscape for IT talent.
• Capable of working independently and collaboratively in a fast-paced environment with a focus on achieving recruitment targets.

• Roles and ResponsibilitiesIdentify and source potential candidates using a variety of online and offline recruiting channels.
• Screen resumes and applications to shortlist suitable candidates for further evaluation.
• Conduct preliminary interviews to assess candidates' qualifications and fit for specific roles.
• Collaborate with hiring managers to understand job requirements and develop effective recruitment strategies.
• Manage candidate pipelines and maintain records in the Applicant Tracking System.
• Coordinate and schedule interviews between candidates and hiring teams.
• Ensure a positive candidate experience throughout the hiring process.
• Assist in crafting attractive job descriptions and recruitment advertisements.

JOB DETAILS:

* Job Title: Lead II - Software Engineering - AWS, Apache Spark (PySpark/Scala), Apache Kafka

* Industry: Global digital transformation solutions provider

* Salary: Best in Industry

* Experience: 5-8 years

* Location: Hyderabad

Job Summary

We are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The role involves working with large-scale batch and real-time data processing systems, collaborating with cross-functional teams, and ensuring data reliability, security, and performance across the data lifecycle.

Key Responsibilities

ETL Pipeline Development & Optimization

• Design, develop, and maintain complex end-to-end ETL pipelines for large-scale data ingestion and processing.
• Optimize data pipelines for performance, scalability, fault tolerance, and reliability.

Big Data Processing

• Develop and optimize batch and real-time data processing solutions using Apache Spark (PySpark/Scala) and Apache Kafka.
• Ensure fault-tolerant, scalable, and high-performance data processing systems.

Cloud Infrastructure Development

• Build and manage scalable, cloud-native data infrastructure on AWS.
• Design resilient and cost-efficient data pipelines adaptable to varying data volume and formats.

Real-Time & Batch Data Integration

• Enable seamless ingestion and processing of real-time streaming and batch data sources (e.g., AWS MSK).
• Ensure consistency, data quality, and a unified view across multiple data sources and formats.

Data Analysis & Insights

• Partner with business teams and data scientists to understand data requirements.
• Perform in-depth data analysis to identify trends, patterns, and anomalies.
• Deliver high-quality datasets and present actionable insights to stakeholders.

CI/CD & Automation

• Implement and maintain CI/CD pipelines using Jenkins or similar tools.
• Automate testing, deployment, and monitoring to ensure smooth production releases.

Data Security & Compliance

• Collaborate with security teams to ensure compliance with organizational and regulatory standards (e.g., GDPR, HIPAA).
• Implement data governance practices ensuring data integrity, security, and traceability.

Troubleshooting & Performance Tuning

• Identify and resolve performance bottlenecks in data pipelines.
• Apply best practices for monitoring, tuning, and optimizing data ingestion and storage.

Collaboration & Cross-Functional Work

• Work closely with engineers, data scientists, product managers, and business stakeholders.
• Participate in agile ceremonies, sprint planning, and architectural discussions.

Skills & Qualifications

Mandatory (Must-Have) Skills

1. AWS Expertise

• Hands-on experience with AWS Big Data services such as EMR, Managed Apache Airflow, Glue, S3, DMS, MSK, and EC2.
• Strong understanding of cloud-native data architectures.

1. Big Data Technologies

• Proficiency in PySpark or Scala Spark and SQL for large-scale data transformation and analysis.
• Experience with Apache Spark and Apache Kafka in production environments.

1. Data Frameworks

• Strong knowledge of Spark DataFrames and Datasets.

1. ETL Pipeline Development

• Proven experience in building scalable and reliable ETL pipelines for both batch and real-time data processing.

1. Database Modeling & Data Warehousing

• Expertise in designing scalable data models for OLAP and OLTP systems.

1. Data Analysis & Insights

• Ability to perform complex data analysis and extract actionable business insights.
• Strong analytical and problem-solving skills with a data-driven mindset.

1. CI/CD & Automation

• Basic to intermediate experience with CI/CD pipelines using Jenkins or similar tools.
• Familiarity with automated testing and deployment workflows.

Good-to-Have (Preferred) Skills

• Knowledge of Java for data processing applications.
• Experience with NoSQL databases (e.g., DynamoDB, Cassandra, MongoDB).
• Familiarity with data governance frameworks and compliance tooling.
• Experience with monitoring and observability tools such as AWS CloudWatch, Splunk, or Dynatrace.
• Exposure to cost optimization strategies for large-scale cloud data platforms.

Skills: big data, scala spark, apache spark, ETL pipeline development

******

Notice period - 0 to 15 days only

Job stability is mandatory

Location: Hyderabad

Note: If a candidate is a short joiner, based in Hyderabad, and fits within the approved budget, we will proceed with an offer

F2F Interview: 14th Feb 2026

3 days in office, Hybrid model.

Position: Microsoft .NET Full Stack Developer

Experience: 4–6 Years

Open Positions: 10

Location: PAN India (Final Round – Face-to-Face Interview)

Budget: Up to 15 LPA

Notice Period: Immediate joiners preferred

Key Responsibilities:

· Work on highly distributed and scalable system architecture

· Design, develop, test, and maintain high-quality software solutions

· Ensure performance, security, and maintainability of applications

· Collaborate with cross-functional teams and stakeholders

· Perform system testing and resolve technical issues

Required Skills:

· Strong experience in ASP.NET, C#, .NET Core, MVC

· Hands-on experience with SQL Server / PostgreSQL

· Experience in Angular / React (Frontend technologies)

· Knowledge of microservices architecture & RESTful APIs

· Familiarity with CQRS pattern

· Exposure to AWS / Docker / Kubernetes

· Experience with CI/CD pipelines (Azure DevOps, Jenkins)

· Knowledge of Node.js is an added advantage

· Understanding of Agile methodology

· Good exposure to cybersecurity and compliance

Technology Stack:

· Microsoft .NET technologies (primary)

· Cloud platforms: AWS (SaaS/PaaS/IaaS)

· Databases: MSSQL, MongoDB, PostgreSQL

· Caching: Redis, Memcached

· Messaging queues: RabbitMQ, Kafka, SQS

Role Summary

We are seeking a Full-Stack Developer to build and secure features for our Therapy Planning Software (TPS), which integrates with RMS/RIS, EMR systems, devices (DICOM, Bluetooth, VR, robotics, FES), and supports ICD–ICF–ICHI coding. The role involves ~40% frontend and 60% backend development, with end-to-end responsibility for security across application layers.

Responsibilities

Frontend (40%)

1. Build responsive, accessible UI in React + TypeScript (or Angular/Vue).
2. Implement multilingual (i18n/l10n) and WCAG 2.1 accessibility standards.
3. Develop offline-capable PWAs for home programs.
4. Integrate REST/FHIR APIs for patient workflows, scheduling, and reporting.
5. Support features like voice-to-text, video capture, and compression.

Backend (60%)

1. Design and scale REST APIs using Python (FastAPI/Django).
2. Build modules for EMR storage, assessments, therapy plans, and data logging.
3. Implement HL7/FHIR endpoints and secure integrations with external EMRs.
4. Handle file uploads (virus scanning, HD video compression, secure storage).
5. Optimize PostgreSQL schemas and queries for performance.
6. Implement RBAC, MFA, PDPA compliance, edit locks, and audit trails.

Security Layer (Ownership)

1. Identity & Access: OAuth2/OIDC, JWT, MFA, SSO.
2. Data Protection: TLS, AES-256 at rest, field-level encryption, immutable audit logs.
3. Compliance: PDPA, HIPAA principles, MDA requirements.
4. DevSecOps: Secure coding (OWASP ASVS), dependency scanning, secrets management.
5. Monitoring: Logging/metrics (ELK/Prometheus), anomaly detection, DR/BCP preparedness.

Requirements

• Strong skills in Python (FastAPI/Django) and React + TypeScript.
• Experience with HL7/FHIR, EMR data, and REST APIs.
• Knowledge of OAuth2/JWT authentication, RBAC, audit logging.
• Proficiency with PostgreSQL and database optimization.
• Cloud deployment (AWS/Azure) and containerization (Docker/K8s) a plus.

Added Advantage

• Familiarity with ICD, ICF, ICHI coding systems or medical diagnosis workflows.

Success Metrics

• Deliver secure end-to-end features with clinical workflow integration.
• Pass OWASP/ASVS L2 security baseline.
• Establish full audit trail and role-based access across at least one clinical workflow.

Key Responsibilities:

• Develop and maintain end-to-end web applications
• Build responsive frontends using React
• Create robust backend APIs using Java and Spring Boot
• Collaborate with cross-functional teams (Product, QA, DevOps)
• Write clean, testable, and scalable code
• Participate in code reviews and Agile development processes

Requirements:

• 4.5+ years of hands-on experience in full stack development
• Strong knowledge of Java, Spring Boot, and React.js
• Good understanding of REST APIs and microservices architecture
• Familiarity with version control (Git) and CI/CD pipelines
• Excellent debugging, troubleshooting, and communication skills

Bonus: Immediate joiners will be prioritized!

Job ID: DP0601

Job Description:- 

Job Location- Bangalore, Hyderabad(Type- WFH/Hybrid)

Experience Level- 4-8 Yrs.

Angular JD keywords:

• Experience in Angular 2+ (Latest Version Preferred)
• Strong understanding of the OOPS concept
• Strong understanding of Typescript
• Knowledge of Observables
• Advance knowledge of JavaScript

• 3+ years of industry experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka, ELK Stack, Fluentd and streaming databases like druid
• Strong industry expertise with containerization technologies including kubernetes, docker-compose
• 2+ years of industry in experience in developing scalable data ingestion processes and ETLs
• Experience with cloud platform services such as AWS, Azure or GCP especially with EKS, Managed Kafka
• Experience with scripting languages. Python experience highly desirable.
• 2+ Industry experience in python
• Experience with popular modern web frameworks such as Spring boot, Play framework, or Django
• Demonstrated expertise of building cloud native applications
• Experience in administering (including setting up, managing, monitoring) data processing pipelines (both streaming and batch) using frameworks such as Kafka, ELK Stack, Fluentd
• Experience in API development using Swagger
• Strong expertise with containerization technologies including kubernetes, docker-compose
• Experience with cloud platform services such as AWS, Azure or GCP.
• Implementing automated testing platforms and unit tests
• Proficient understanding of code versioning tools, such as Git
• Familiarity with continuous integration, Jenkins

• Design and Implement Large scale data processing pipelines using Kafka, Fluentd and Druid
• Assist in dev ops operations
• Develop data ingestion processes and ETLs
• Design and Implement APIs
• Assist in dev ops operations
• Identify performance bottlenecks and bugs, and devise solutions to these problems
• Help maintain code quality, organization, and documentation
• Communicate with stakeholders regarding various aspects of solution.
• Mentor team members on best practices

About:

Pangolin is a brand consultancy and creative agency. We help companies create positive change in the world by raising awareness through branding and inspiring through storytelling. We’re growing our team of creatives and strategists. Join us if you’re craving work that makes a real difference in the world, and a work culture that allows you to have a balanced life. 

Role:

B2B Social Media Expert

Description:

Are you intimately familiar with the LinkedIn algorithm? Do you specialize in growing brand following on Twitter? Are you proficient in defining and executing social media strategies for Quora, Reddit, Instagram, and Facebook?  We’re looking for an expert with a solid understanding of how each social media channel works and how to optimize content so that it is engaging. As the B2B Digital Marketing Specialist, you will also be responsible for organizing and producing content that follows our clients’ brand guidelines.

Competencies:

• Consistent and self-driven to learn about social media platforms and trends. 
• Strong creative storytelling skills with a focus on visual and content aesthetics.

Skills:

• Working knowledge of SMM tools like Hootsuite, Moz, Loomly, etc.
• Working knowledge of design applications like Adobe Suite, Canva, etc., and other video editing tools.
• Adept at digital tools like Facebook Insights, Twitter Analytics, Google Analytics/Google Ad Manager.
• Adept at communicating in a professional, but unique social media “voice” for each client; directly aligned with the clients’ thought leadership and content platform.

Experience:

• Demonstrable B2B social networking experience and social analytics tools.
• Experience in managing multiple digital marketing campaigns with the ability to analyze and make recommendations on performance.
• Strong understanding of social media KPIs, keyword optimization tools, and social media algorithms.

Location and Type: 

Remote, Full-time

Evaluation:

Portfolios will be checked for expertise in the B2B domain. Please share only case studies of growth where the strategy and execution were owned end-to-end by you. Shortlisting will be followed by a video interview.