11+ Apache Flume Jobs in Hyderabad | Apache Flume Job openings in Hyderabad

We are seeking a Senior Data Engineer to design, build, and maintain a robust, scalable on-premise data infrastructure. The role focuses on real-time and batch data processing using technologies such as Apache Pulsar, Apache Flink, MongoDB, ClickHouse, Docker, and Kubernetes.

Ideal candidates have strong systems knowledge, deep backend data experience, and a passion for building efficient, low-latency data pipelines in a non-cloud, on-prem environment.

Key Responsibilities

1. Data Pipeline & Streaming Development

• Design and implement real-time data pipelines using Apache Pulsar and Apache Flink to support mission-critical systems.
• Build high-throughput, low-latency data ingestion and processing workflows across streaming and batch workloads.
• Integrate internal systems and external data sources into a unified on-premise data platform.

2. Data Storage & Modelling

• Design efficient data models for MongoDB, ClickHouse, and other on-prem databases to support analytical and operational use cases.
• Optimize storage formats, indexing strategies, and partitioning schemes for performance and scalability.

3. Infrastructure & Containerization

• Deploy, manage, and monitor containerized data services using Docker and Kubernetes in on-prem environments.

4. Performance, Monitoring & Reliability

• Monitor and fine-tune the performance of streaming jobs and database queries.
• Implement robust logging, metrics, and alerting frameworks to ensure high availability and operational stability.
• Identify pipeline bottlenecks and implement proactive optimizations.

Required Skills & Experience

• Strong experience in data engineering with a focus on on-premise environments.
• Expertise in streaming technologies such as Apache Pulsar, Apache Flink, or similar platforms.
• Deep hands-on experience with MongoDB, ClickHouse, or other NoSQL/columnar databases.
• Proficient in Python for data processing and backend development.
• Practical experience deploying and managing systems using Docker and Kubernetes.
• Strong understanding of Linux systems, performance tuning, and resource monitoring.

Preferred Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related fields (or equivalent experience).

Additional Responsibilities for Senior-Level Hires

Leadership & Mentorship

• Guide, mentor, and support junior engineers; establish best practices and code quality standards.

System Architecture

• Lead the design and optimization of complex real-time and batch data pipelines for scalability and performance.

Sensor Data Expertise

• Build and optimize sensor-driven data pipelines and stateful stream processing systems for mission-critical domains such as maritime and defense.

End-to-End Ownership

• Take full responsibility for the performance, reliability, and optimization of on-premise data systems.

Servicenow Scripting candidates with UI and Portal / platform development.

Position - ServiceNow Consultant

Exp : 5+ yrs

Shift - UK

Hands on experience in Java Script, HTML, CSS,XML, AJAX, Angular JS & React JS

A fundamental understanding of ITSM, ITIL or CMDB.

Good to have- ServiceNow Certification, CSA, CAD, CIS- ITSM

Hands-on design, development, and deployment experience with the ServiceNow platform.

End to End Integration Exp. Using Scripted Rest API, Rest API (Outbound & Inbound) & Authentication Process.

ServiceNow implementation experience in ITSM, Service Portal, Performance Analytics (Adv. Reporting) & Employee Centre Knowledge.

Should be multitasking, Self-Learner and possess good Functional Knowledge.

Should be able to take lead on Project, Support activity and guide or train the team.

Strong communication, presentation, and problem-solving skills.

Thorough understanding of ITIL/ITSM processes.

Working knowledge of ITBM process and implementation

Golang Developer

Location: Chennai/ Hyderabad/Pune/Noida/Bangalore

Experience: 4+ years

Notice Period: Immediate/ 15 days

Job Description:

• Must have at least 3 years of experience working with Golang.
• Strong Cloud experience is required for day-to-day work.
• Experience with the Go programming language is necessary.
• Good communication skills are a plus.
• Skills- Aws, Gcp, Azure, Golang

Skills Set:

ü Good at communication skills.

ü Excellent Analytical, Problem solving skills.

ü Strong Programming skills in HTML, CSS, JavaScript, Ionic, Cordova, NodeJS.

ü Good exposure to Object oriented programming and MVC coding standards.

ü Excellent knowledge of MySQL/MS SQL Database is required in terms of designing database, SQL queries.

ü Knowledge of optimizing techniques.

Must skills:

Hands- on in the following:

• Java 8/J2EE
• Spring boot
• Gradle/Maven
• REST API
• ORM- hibernate/ JPA
• Unit Testing and Integration Testing- Junit/ TestNG

Good to have:

Hands-on in the following:

• CI/CD pipeline deployment
• Messaging- ActiveMQ/RabbitMQ/MQ
• DB2
• Kafka
• NoSQL framework exposure

• M. Com with 4 / 5 years of experience,
• CA Inter with 3 to 5 years of experience,
• preferably in MIS reporting, Monthly closing of Books of Account, preparation of P&L, Balance Sheet, Schedules, etc.
• Working knowledge in SAP preferable 

MTX Group Inc. is seeking a motivated AI Solution Architect to join our team. MTX Group Inc. is a global implementation partner enabling organizations to become fit enterprises. MTX provides expertise across various platforms and technologies, including Google Cloud, Salesforce, artificial intelligence/machine learning, data integration, data governance, data quality, analytics, visualization and mobile technology. MTX’s very own Artificial Intelligence platform Maverick, enables clients to accelerate processes and critical decisions by leveraging a Cognitive Decision Engine, a collection of purpose-built Artificial Neural Networks designed to leverage the power of Machine Learning. The Maverick Platform includes Smart Asset Detection and Monitoring, Chatbot Services, Document Verification, to name a few.

Responsibilities:

• Creative translation of business needs into a conceptual, logical and physical architecture design of the solution
• Collaboration with the technical teams needed to deliver the design
• Leading architecture and design competency for the automation technology stack
• Strategic direction for maximizing simplification and re-use lowering overall TCO
• Creation of solutions which adhere to Enterprise Architecture, Development, and Information Risk Management standards and policies
• Collaboration with developers and engineering teams resolving the most challenging tasks ensuring the proposed design is properly implemented.
• Proactively identify and address technical strengths, weaknesses, opportunities and threats across the automation landscape
• Strategy for managing the changes to the architecture (new business needs, technology changes, etc.)
• Explain architecture standards and recommendation to business partners and drive alignment

What you will bring:

• Minimum 5 years of hands-on experience in the IT field, at least 3 years in IT architecture
• Solid experience as solution and platform architect, providing technical leadership and guidance designing enterprise software.
• Proven track record at managing multiple projects in fast paced cross-functional team environment.
• 1+ year year experience working with chatbots is a plus
• 2+ years hands-on experience with Microsoft Azure and Amazon Web Services
• Working knowledge of Machine Learning, techniques, algorithms, natural language processing
• Certifications in multiple cloud platforms is ideal
• 2+ years of experience working in an Agile Scrum / DevOps development methodology.

What we offer:

• Group Medical Insurance (Family Floater Plan - Self + Spouse + 2 Dependent Children)
• Sum Insured: INR 5,00,000/- 
• Maternity cover upto two children
• Inclusive of COVID-19 Coverage
• Cashless & Reimbursement facility
• Access to free online doctor consultation

• Personal Accident Policy (Disability Insurance) -

• Sum Insured: INR. 25,00,000/- Per Employee
• Accidental Death and Permanent Total Disability is covered up to 100% of Sum Insured
• Permanent Partial Disability is covered as per the scale of benefits decided by the Insurer
• Temporary Total Disability is covered

• An option of Paytm Food Wallet (up to Rs. 2500) as a tax saver  benefit
• Monthly Internet Reimbursement of upto Rs. 1,000 
• Opportunity to pursue Executive Programs/ courses at top universities globally
• Professional Development opportunities through various MTX sponsored certifications on multiple technology stacks including Salesforce, Google Cloud, Amazon & others

• 5+ years of software development or site reliability engineering or equivalent experience
• Skilled at problem solving, algorithms, and data structures
• Building tools and scripting frameworks from scratch
• Working with Cloud Automation tools like CloudFormation, Terraform, CDK, aws-cli
• Scripting languages like Python, Groovy, PowerShell, Bash, Perl etc.
• Configuration automation using Ansible or equivalent tools
• Exposure to Windows, Linux administration skills
• Project management tools like Jira, Trello
• Prior experience in dealing with Datastore technologies like Postgres, MySQL, SQL, DynamoDB is desirable
• Familiarity with basic networking, security and cloud engineering concepts
• Team player who is eager to help others to succeed through mentoring and leading by example
• Highly collaborative with effective written and verbal communication skills