(Hadoop, HDFS, Kafka, Spark, Hive)
Overall Experience - 8 to 12 years
Relevant exp on Big data - 3+ years in above
Salary: Max up-to 20LPA
Job location - Chennai / Bangalore /
Notice Period - Immediate joiner / 15-to-20-day Max
The Responsibilities of The Senior Data Engineer Are:
- Requirements gathering and assessment
- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach
- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic
- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.
- Mentoring juniors in a dynamic team setting
- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values
A Candidate Must Have the Following Skills:
- Strong problem-solving ability
- Excellent software design and implementation ability
- Exposure and commitment to agile methodologies
- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance
- Minimum 8 years of experience
- Should have experience in full life-cycle of one big data application
- Strong understanding of various storage formats (ORC/Parquet/Avro)
- Should have hands on experience in one of the Hadoop distributions (Hortoworks/Cloudera/MapR)
- Experience in at least one cloud environment (GCP/AWS/Azure)
- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)
- Bachelor's in Computer Science, and preferably, a Masters as well - Should have good code review and debugging skills
Additional skills (Good to have):
- Experience in Containerization (docker/Heroku)
- Exposure to microservices
- Exposure to DevOps practices - Experience in Performance tuning of big data applications

Similar jobs
DevOps Engineer (Cloud & Infrastructure)
📍 Noida | 🕐 Full-Time | 🧭 Experience: 2–4 years
About TestMu AI
TestMu AI (formerly LambdaTest) is an AI-native platform designed to move software testing beyond simple automation into the era of agentic intelligence. It provides end-to-end AI agents that manage the entire Quality Engineering lifecycle.
- Full-Stack AI Agents: Autonomously plan, author, execute, and analyze tests across the SDLC.
- Comprehensive Coverage: Supports web, mobile, and enterprise applications.
- Real-World Testing: Scale execution across real devices, browsers, and custom environments.
About the Role
This isn't a role for someone who just wants to "maintain" systems. As a DevOps Engineer at TestMu AI, you are the architect of the automated highways that power our AI agents. You will step into a fast-paced environment where you bridge the gap between cloud-native automation and core infrastructure.
You will manage complex CI/CD pipelines, troubleshoot deep-seated Linux issues, and ensure our hybrid-cloud environment (AWS/Azure) is as resilient as the code it runs.
Key Responsibilities: The Pillars of Growth
A. DevOps & Automation (50% Focus)
- Platform Orchestration: Lead the migration to modular, self-healing Terraform and Helm templates.
- Agentic CI/CD: Architect GitHub Actions workflows that treat AI agents as first-class citizens, automating environment promotion and risk scoring.
- Kubernetes Mastery: Advanced management of Docker and K8s clusters to support scalable production workloads.
- Predictive Observability: Use Prometheus, Grafana, and ELK to move from reactive alerts to autonomous anomaly detection.
B. Networking & Data Center Mastery (30% Focus)
- Hybrid Networking: Design and troubleshoot VPCs and subnets in Azure/AWS/GCP, paired with physical VLANs and switches in our data centers.
- Bare-Metal Lifecycle: Automate hardware provisioning, RAID setup, and firmware updates for our real-device cloud.
- Remote Admin: Master out-of-band management (iDRAC, iLO, IPMI) to ensure 100% remote operational capability.
- Core Protocols: Own the lifecycle of DNS, DHCP, Load Balancing, and IPAM across distributed environments.
C. Development & Scripting (20% Focus)
- Backend Integration: Debug and optimize Python or Go code; understanding how logic interacts with system-level resources.
- Advanced Scripting: Write idempotent Bash/Python scripts to automate complex, multi-server operational tasks.
- Agentic Tooling: Support the integration of LLM-based developer tools into DevOps workflows to eliminate "toil".
The Interview Journey
We value your ability to solve problems under pressure more than your ability to memorize documentation.
- Technical Round 1 (DevOps Leads): A live session focused on real-world debugging scenarios and Linux fundamentals.
- Technical Round 2 (Hiring Manager / Pod Lead): An assessment of your architectural thinking, automation strategy, and team alignment.
- Technical Round 3 (SVP Engineering / VP DevOps): Strategic discussion on scalability, infrastructure vision, and technical leadership.
- Final Round (CEO): Mission alignment, cultural fit, and the "big picture" at TestMu AI.
Growth Timeline
This is a high-visibility role. You will receive direct mentorship from our senior engineering leadership. As you master our production environment, you will have a clear path to move into Senior DevOps Engineer or Infrastructure Architect roles as our pods scale.
Perks That Matter
Health Cover: Comprehensive insurance for you and your family.
Fresh Meals: Daily catered meals at the office.
Transport: Safe cab facilities for eligible shifts.
Pod Budgets: Dedicated engagement budgets for team building and offsites.
Role Summary
We’re seeking a seasoned Azure Data Engineer / Consultant to lead design, build, and operationalize cloud-native data solutions. You’ll partner with external clients—from discovery through Go-Live—to ingest, model, transform, and serve high-volume data using Synapse, Fabric, PySpark, and SQL. You’ll also establish best practices around CI/CD, security, and data quality within a medallion architecture.
Required Skills (at least 4+ years of relevant experience - this is a senior-level role)
- Ability to talk to the customer
- Manage the delivery of an End-To-End Enterprise project
- Fabric (or Synapse/ADF/Databricks) Data Engineering background
- Data Warehousing experience
- Basic understanding of Agentic AI
Preferred Skills & Certifications:
- DP-600, DP-700 or equivalent certification.
- Experience with Azure Purview, Data Catalogs, or metadata management tools.
- Familiarity with orchestration frameworks (ADF, Synapse Pipelines), Spark optimization (broadcast joins, partition pruning), and data-quality frameworks (Great Expectations, custom).
- Prior consulting or client-facing engagements in enterprise environments.
- Knowledge of BI tools (Power BI).
What We Offer:
- Opportunity to own and shape cutting-edge data solutions for diverse industries.
- Collaborative, outcome-driven culture with career growth and skill-building opportunities.
- Competitive compensation and benefits package.
About the Role
Cyber Toddler is offering a Cybersecurity Research Internship designed for students and aspiring cybersecurity professionals interested in digital threats, cyber awareness, and security research.
This internship provides structured exposure to cybersecurity concepts, industry trends, and practical research activities.
Key Responsibilities
- Research cybersecurity topics and digital threats
- Assist with cyber awareness initiatives
- Support cybersecurity content and learning resources
- Monitor emerging cyber trends and incidents
- Contribute to internal knowledge and research activities
Requirements
- Interest in cybersecurity and digital safety
- Basic understanding of cybersecurity concepts
- Research and analytical thinking skills
- Willingness to learn and grow
- Good communication skills
PCCSE (Prisma certified cloud security engineer) with 5 years of experience.
On site engineers with ability to work in 24-7 support environments.

Dolat Capital is a multi-strategy trading firm, dedicated to producing superior returns by adhering to mathematical and statistical techniques. We trade actively in all Asset classes: equities, futures, options, commodities, currencies and fixed income taking advantage of our ultra-low latency infrastructure. Our low latency infrastructure is in C++, one of the most competitive in terms of latency.
The Quantitative Research team at Dolat Capital focuses on quantitative trading, specifically fully automated trading systems. We develop proprietary algorithms by using mathematical techniques and statistical analysis to identify patterns and behavior of markets.
The incumbent will be responsible to design, develop and implement computational algorithms/strategies that succeed in generating sizable profits consistently, in real life market for a high-frequency trading environment
Looking Data Enginner for our Own organization-
Notice Period- 15-30 days
CTC- upto 15 lpa
Preferred Technical Expertise
- Expertise in Python programming.
- Proficient in Pandas/Numpy Libraries.
- Experience with Django framework and API Development.
- Proficient in writing complex queries using SQL
- Hands on experience with Apache Airflow.
- Experience with source code versioning tools such as GIT, Bitbucket etc.
Good to have Skills:
- Create and maintain Optimal Data Pipeline Architecture
- Experienced in handling large structured data.
- Demonstrated ability in solutions covering data ingestion, data cleansing, ETL, Data mart creation and exposing data for consumers.
- Experience with any cloud platform (GCP is a plus)
- Experience with JQuery, HTML, Javascript, CSS is a plus.
Role 1 : Core Java
Experience - 5 – 10 years
Location – Mumbai ( NKP) / Weworks
Primary Skills / Must have:
- Knows Java Programming Language (Java 7, 8) with Object-Oriented Design and Spring Framework. Understanding of RESTFul Services development.
- Has a good understanding of asynchronous requests, multithreading and related issues and ways to resolve them.
- Has a good understanding of web and web programming principles, cookies, sessions etc.
- Familiar with tomcat, servlet model and their limitations.
- Has a good understanding of basic algorithms and data structures.
- Good analytical skills, problem-solving skills and willingness to learn.
- Good communication and collaboration skills. Willing to ask questions.
- Team player.
Secondary Skills / Desired skills
- Modern web development tools including JavaScript frameworks such as Angular JS and CSS frameworks such as Bootstrap.
- Familiarity with Git and Linux/Unix commands.
Role 2 – JAVA + Linux + SQL Server combination of skills - Bangalore
Experience – 4 – 9 years
Location – Bangalore ( RMZ Ecoworld)
Required Technical Skills:
- Strong Java experience.
- Experienced in Agile development lifecycle.
- Hands-on experience with Programming language: Python, and SQL
- Experience in database platforms : DB2/Sybase/MSSQL server.
- Working knowledge of Linux/Unix.
- Working knowledge of Java spring framework,Angular 7/8,GIT.
Desired Technical Skills:
- Working experience on Actimize RCM solution.
- Knowledge of testing automation tools like selenium.
- Good knowledge of Actimize AIS solution
- CI/CD
Required Aptitudes
- Ability to take on challenges and open to learning new technologies.
- Ability to work on multiple projects at the same time.
- Passion for innovation and find creative solutions to complex business problems.
- Team player.
Educational qualification and experience:
- Bachelor degree in engineering/computer science or MCA from recognized institution
- Minimum 3 years of development experience in required technical skills.
Role 3 – Java+ Spring + Azure ( Mandatory)
Location – Bangalore
Experience – 4 – 7 years
Role 4 – Java Fullstack
Experience - 5 – 9 years
Location – Mumbai ( NKP)
No of open role – 4
Mandatory Skills – Core Java , Full stack and Unix
Responsibilities Include:
Ø Work closely with Business Analysts to understand User and Functional Requirements
Ø Conduct Technical Design, create Design Prototype and Design Specifications. Be able to understand business needs and translate into technology solutions
Ø Implement the requirements using the latest firm wide technologies and approved global solutions
Ø Perform Unit Testing and, wherever applicable, collaborate with QA Engineer on System / Integration / QA / Regression / Performance / Capacity Testing, and create testing documentation
Ø Coordinate with users on User Acceptance Testing and provide testing support
Required technical skills:
Ø Minimum 3-4 years of hands-on experience in software development
Ø Good programming skills using Java
Ø Excellent relational database skills on Sybase / DB2 & Unix Shell Scripting
Ø Good knowledge and solid experience in Agile software development
Ø Good knowledge, skills and abilities to perform high quality software testing
Ø Experience on Axiom / XML / SOAP / Informatica is preferred but not essential
Required professional skills:
Ø Enthusiasm for and interest in learning and applying new technologies to solve real world business problems
Ø Pursuit for perfect delivery quality in a zero-error-tolerance environment
Ø Strong analytical and problem solving skills
Ø Good communication skills including ability to explain technical issues to non-technical people
Ø Highly organized, self-motivated, result-oriented, and proactive with capability to work with minimal supervision
Ø A strong can-do attitude
Ø Creative and flexible while observing policies, rules and standards
Demonstrate highly proficient written and verbal communication skills in the English language
Role 5 – Core Java / Java backend hands on developer
Location – Mumbai and Banglare
Experience - 5 – 10 years /











