(Hadoop, HDFS, Kafka, Spark, Hive)
Overall Experience - 8 to 12 years
Relevant exp on Big data - 3+ years in above
Salary: Max up-to 20LPA
Job location - Chennai / Bangalore /
Notice Period - Immediate joiner / 15-to-20-day Max
The Responsibilities of The Senior Data Engineer Are:
- Requirements gathering and assessment
- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach
- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic
- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.
- Mentoring juniors in a dynamic team setting
- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values
A Candidate Must Have the Following Skills:
- Strong problem-solving ability
- Excellent software design and implementation ability
- Exposure and commitment to agile methodologies
- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance
- Minimum 8 years of experience
- Should have experience in full life-cycle of one big data application
- Strong understanding of various storage formats (ORC/Parquet/Avro)
- Should have hands on experience in one of the Hadoop distributions (Hortoworks/Cloudera/MapR)
- Experience in at least one cloud environment (GCP/AWS/Azure)
- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)
- Bachelor's in Computer Science, and preferably, a Masters as well - Should have good code review and debugging skills
Additional skills (Good to have):
- Experience in Containerization (docker/Heroku)
- Exposure to microservices
- Exposure to DevOps practices - Experience in Performance tuning of big data applications

Similar jobs
AI Product QA Engineer
This is not the QA you know. We're not hiring someone to find bugs. We're hiring someone to guard the user's experience — with AI as the foundation.
Read this before you read anything else
Forget everything traditional QA taught you.
I don't want "I tested it, here are the 14 defects." I don't want a gatekeeper at the end of the line ticking checkboxes against a technical feature list. That QA is dead here, and honestly, AI already does it better.
I want business-product QA. Product taste as a discipline. User empathy as a test case. Your foundation is AI — everything runs through Claude Code / Codex — and on top of that foundation you apply QA from a business, user-empathy, onboarding, and go-to-market lens. You're not asking "does the button work?" You're asking "is this the sharpest user journey this product could possibly have?"
We're extreme about four things and nothing else: extreme hard work, extreme respect, extreme shipping, extreme innovation. Not hours . There's no boss — there's a product, a user, and you. You're rewarded on one thing: your hunger.
The 90 / 10
Same philosophy that runs this whole company. 90% of the work, AI does. Claude Code writes the test cases, automates the suites, drives the API calls, spins up the harness — faster than any QA team I've ever run . That 90% is the floor now.
The 10% is you — the human who decides what's actually worth testing and why:
- the user empathy — feeling the friction a real brand manager feels at 9pm
- the judgment — is this the sharpest journey, or just a working one?
- the taste — the design standard, the elegance, the delight
- the business sense — does this survive a real client's Tuesday, their onboarding, their objection?
- the critical eye — reading an AI trace and knowing instantly when the product is confidently wrong
AI didn't shrink QA. It concentrated it. The 10% is smaller and heavier than the 100% ever was. That's the 10% I'm hiring.
How you actually work
Everything you do runs through Claude Code. You write the cases in it. You automate the cases in it. You do business testing in it. You interrogate user empathy in it — "how will the user react to this, and is this the sharpest journey of the product?"
But make no mistake: this is technical QA. You write scripts. You hit and test APIs directly. You read the traces, the payloads, the failure modes. You don't wait for a UI to click — you go straight at the system. The difference from old-school QA isn't less technical; it's technical in service of the user and the business, not the feature checklist.
The stack & the surface
We're a web application in Python, Rust, and everything in between — and you'll be QA-ing across four products: ARIA, the Persona product, the video-decoding product, and the rest of the family. Real APIs, real pipelines, real agents watching millions of social videos in Hindi, Tamil, Bahasa, Thai for the world's biggest consumer brands . You need to be comfortable writing a script to probe any of them and reading exactly what came back.
Your first 48 hours
Day one, morning: you get access to a live product and its real client questions in the queue. Not a sandbox. Not a tutorial.
Day one, afternoon: you pick one user journey and, in Claude Code, you build the case, automate it, and pressure-test it against the actual experience a client would have.
Day two: you tell me not "here are the defects" but "here's where the journey breaks the user, and here's the sharper one." And you've already got the automated eval that guards it going forward.
If that scares you, this isn't your room. If it makes you grin — keep reading.
The loop
We are always on. A technique drops on Twitter Tuesday morning; by Thursday it's in a product; by Friday a brand team on the other side of the world is using it — and someone has to make sure that journey is delightful, not just functional. That someone is you. See it. Test it against the user. Sharpen it. Ship it. The loop never stops. If your learning lives in "read later" folders , this will break you.
What you own
The user's experience across every product. Not the defect list — the journey. Find a problem and you don't just log the instance; you build the automated eval in Claude Code that kills the whole class of bad experience forever. Your evals become the product's conscience. Your standard becomes the bar the whole team ships to.
The bar is craft, not years. 23 or 43 — I don't care. I care whether you can feel what a user feels and write the script that proves it.
Who this is actually for
This is a close-to-100% self-starter environment.
You do not want to be here if you want to be handed a test plan. You want to be here if you believe you're the only one who can guard this product's soul — the king or queen of the user journey — with absolute hunger burning in you to do it. Here, will is bigger than skill. And AI isn't a tool you use; it's the foundation you think on.
Fair warning ⚠
The pace is relentless and there's no playbook for AI-product QA — you're partly inventing the discipline as you go. If you want a stable checklist and a comfortable gate at the end of the pipeline, you'll be miserable here, and I'd rather you know now. But if you want to define what QA even means in the age of agents — what you learn here in one year, you won't learn anywhere else in five.
How this goes
Don't send a resume. Send the 10%.
An eval harness you're proud of. A test suite you built in Claude Code that caught something a checklist never would. A teardown of a product's user journey where your taste and your technical chops were unmistakably yours.
Work Location: Remote
Job Title: Data Engineer
Location: Pune, India
Experience: 5 to 9 years
Job Description:
We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.
Required Skills:
- Python: Advanced proficiency with extensive experience in building data pipelines.
- AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
- Spark: Proficient in using Apache Spark for large-scale data processing.
- Scala: Working knowledge of Scala for Spark programming.
- Strong understanding of data warehousing concepts and ETL processes.
- Experience with SQL and relational databases.
- Familiarity with data governance and security best practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
We are seeking a dynamic and results-driven Business Development Specialist with experience in the digital marketing industry to help drive growth and expand our client base. The ideal candidate will have a deep understanding of digital marketing services, including SEO, PPC, content marketing, and social media, combined with a proven ability to generate leads, close deals, and build strong client relationships.
Key Responsibilities:
- Identify and pursue new business opportunities within the digital marketing industry.
- Develop and execute strategies to expand the company’s market presence and drive revenue growth.
- Build and maintain long-term relationships with clients and stakeholders.
- Conduct market research to identify emerging trends, client needs, and potential partnerships.
- Collaborate with internal teams (SEO, PPC, content, and social media) to ensure seamless integration of marketing solutions for clients.
- Prepare and deliver compelling sales presentations, proposals, and pitches tailored to client needs.
- Manage and track the sales pipeline, from lead generation to contract negotiation and closing.
- Meet or exceed sales and revenue targets by converting prospects into clients.
- Attend industry events, networking opportunities, and conferences to build brand presence and client relationships.
Qualifications:
- Proven experience in business development, sales, or account management within the digital marketing industry.
- Strong understanding of digital marketing services, including SEO, PPC, content marketing, social media, and web development.
- Excellent communication, negotiation, and presentation skills.
- Ability to work independently and manage multiple client relationships simultaneously.
- Strong analytical skills and the ability to understand client needs and translate them into effective marketing solutions.
- Proficiency with CRM software and digital marketing tools (e.g., HubSpot, Google Analytics, SEMrush) is a plus.
- Bachelor's degree in marketing, business, or a related field is preferred.
Why Join Us:
- Opportunity to work in a fast-paced, growing digital marketing agency.
- Collaborative team environment with opportunities for career growth and professional development.
- Competitive salary and performance-based incentives.
Must to have skills :
1. Load testing tools- Jmeter or Gatling
2. Containerization: Docker or kubernetes
3. Created CI/CD pipelines using Jenkins and, integarted them with Jmeter
4. APM tools- Appdynamics/Dynatrace
5. Head dump/thread dump analysis
Primary Responsibilities:
Define performance test strategies for medium to complexity integrated / n-tier application
architecture defined for medium to complexity business functionality applications
You play a key role in the planning, design, scripting, execution, and analysis of various
performance tests of software applications. Design workload based on NFRs
Apply functional knowledge and technical expertise to deliver performance testing projects,
implementation of configuration changes for client applications, and other maintenance of
software applications to meet business process requirements.
The ability to think beyond just what is on the monitor to the servers and architecture of the entire system.
Load Tools: Performance Center, LoadRunner, StormRunner, JMeter, BlazeMeter, Soasta,
OpenSTA, SoapUI.
Frontend Testing : Web Page Test, Google Page Speed, Google Lighthouse
Monitoring Tools : Appdynamics, DynaTrace, New Relic, Nagios/Ops View, Cacti, Wily
Introscope and SiteScope

Hello,
Greetings for the day !!!
Tridat Technologies is hiring for "Full Stack Developer" for one of the top most 3PL solution provider company based @ Mumbai, Goregaon !!!
Desired Candidate Profile :
- Engineering / MCA / Graduate
- Good communication skill.
- Immediate joining preferable, Max 15 days
Job Description:
- Hands-on experience in .Net technology (Mainly C#, WCF, ASP.NET, AngularJS, Node.js, JQuery)
- Strong knowledge of OOP Concept
- Database experience with TSQL (MySQL, SQL Server)
- Experience in developing web applications and web APIs
- Experience in developing mobile projects or Power BI (Good to have)
- Experience with third party web controls
- Experience working with Source Code Management solutions like GIT and Continuous build
integration tools like Jenkins
- Experience in developing client-server, distributed, real-time applications using C#, Web API, Rest API, .NET, .NET Core
- Experience of working in Agile teams, Agile Methodology like Scrum
- Experience in testing software methodologies such as Unit testing, Integration Testing,
performance testing
- Good knowledge and experience in front end technologies like HTML5/CSS3,AJAX, JavaScript
- Self-motivated and deadline focused.
Must Require Skills:
C#, OOPS concept, MVC, Sql, Asp.net, Angularjs
Experience: 2+ yrs
Qualification: Graduate
Working days: Monday to Friday
Employment Type: Contract to hire role for full time basis & permanent opportunity
Location: Goregaon - Mumbai
**NOTE: CANDIDATES FROM PAN INDIA LOCATION HAS TO RELOCATE TO MUMBAI ONCE THE SITUATION GETS SETTLED DOWN
What you will do:
- Processing and reviewing investor capital transaction requests and ensuring that these comply with the relevant legislation, agreements, and policies
- Ensuring transactions are processed observing the guidelines outlined in the agreements, with attention to proper procedures and deadlines
- Upholding our KYC & Compliance framework in place working closely with the Risk & Data team to ensure monitoring & portfolio performance.
- Processing wire payments and account transfer transactions through multiple banking platforms to settle payouts
- Daily reconciliations of our accounts
- Updating investor wire details, upon request, to ensure flow to available automated payment systems
- Reporting and Client Management
- Ensuring client and investor-related queries are handled
- Preparing and releasing monthly reporting.
- Preparing periodic fund activity reports for submission to relevant clients or their regulatory bodies.
- Coordinating client-specific needs between teams within the department and within the company
- Participating in project-based work
- Overseeing client deliverables and escalations, when needed
What you need to have:
- Experienced Investment / Lending Operations in the investment/hedge fund industry are favorable.
- Experience in completing & closing transactions.
- Experienced in serving demanding clients within an evolving industry, focused on adherence to global financial regulations and compliance procedures would be considered an asset.
- Willingness to work the hours necessary to meet client deliverables
- Minimum 3+ years of ReactJS Web Application development
- Minimum 3+ years of Node.js server-side rendered development
- Experience developing and supporting enterprise-grade applications
- Experience working with Docker or kubernetes
- Strong ability to troubleshoot / debug issues
- Experience integrating REST APIs, ability to quickly pick up new APIs/SDKs
- Capable of working in a fast-paced agile environment
- Strong discipline in documenting engineering processes and best practices
- Disciplined in writing unit tests, test code coverage
Responsibilities:
- Develop backend systems for our first product
- Build reliable, secure and performant backend systems
- Drive test coverage and continuous delivery automation within the team
- Mentor and provide feedback to teammates
Requirements:
- 5+ years of software development experience
- Strong computer science fundamentals
- Deep and wide knowledge of Java ecosystem
- Can write code that is readable, maintainable, secure and performant
- Know the importance of tests and how to approach writing different types of tests
- Good intuition for REST API design
- Deep understanding of relational databases, transactions, entity-relationship modeling
- Comfortable writing highly concurrent systems
- Experienced in using profilers, tuning garbage collection, optimizing SQL queries
Bonus:
- Understanding of domain-driven design concepts like ubiquitous language, bounded contexts, aggregates and domain events
- Know how to use test driven development as a design tool
- Good intuition for the principles underlying object-orientation, particularly encapsulation
- Understand the importance of immutability and of reducing the state-space of objects
- Know how to refactor large codebases safely
- Seek to identify key underlying ideas and use those as building blocks before reaching for shiny new tools
- Data pre-processing, data transformation, data analysis, and feature engineering
- Performance optimization of scripts (code) and Productionizing of code (SQL, Pandas, Python or PySpark, etc.)
- Required skills:
- Bachelors in - in Computer Science, Data Science, Computer Engineering, IT or equivalent
- Fluency in Python (Pandas), PySpark, SQL, or similar
- Azure data factory experience (min 12 months)
- Able to write efficient code using traditional, OO concepts, modular programming following the SDLC process.
- Experience in production optimization and end-to-end performance tracing (technical root cause analysis)
- Ability to work independently with demonstrated experience in project or program management
- Azure experience ability to translate data scientist code in Python and make it efficient (production) for cloud deployment









