
Hadoop Senior Developer/Data Engineering Developer/ETL Developer
at payments bank
- Proficiency in shell scripting
- Proficiency in automation of tasks
- Proficiency in Pyspark/Python
- Proficiency in writing and understanding of sqoop
- Understanding of CloudEra manager
- Good understanding of RDBMS
- Good understanding of Excel

Similar jobs
We are seeking a seasoned Engineering Lead with deep expertise in workflow orchestration systems, stateful execution engines, and distributed task runtimes. You will architect the next generation of our DAG-based runtime, develop the infrastructure for agentic workflow composition, and drive execution excellence across engineering. This role combines hands-on systems design with technical leadership and team mentorship.
Key Responsibilities
1. Architect & Build the Swarm Runtime
- Design and implement a DAG-based orchestration engine using Temporal, Argo Workflows, or equivalent event-driven runtimes.
- Build a scalable primitive registry for tasks, operators, guards, and computational nodes.
- Architect a robust scheduler capable of handling event triggers, retries, backoffs, and distributed coordination.
2. Develop the Workflow Composition Layer
- Define and build a YAML/JSON-based DSL for describing agentic workflows, dependencies, and execution semantics.
- Create a schema-driven rules engine ensuring validations, model calls, parallelism, conditional branching, and approval gates are seamlessly integrated.
3. Orchestration Logic & Runtime Intelligence
- Implement orchestration logic that coordinates:
- Validation layers
- Model calls (LLMs, embedding engines, external APIs)
- Human-in-the-loop approval gates
- Stateful transitions and checkpointing
- Ensure deterministic execution, traceability, and safe rollback mechanisms.
4. Workflow Certification & Automated Testing
- Define certification standards for every workflow type, including:
- Functional correctness
- Latency and concurrency thresholds
- Error-handling expectations
- Observability and trace coverage
- Build automated regression test suites validating workflow integrity before deployment.
5. Engineering Leadership & Delivery
- Lead, mentor, and grow a team of backend and systems engineers.
- Drive sprint planning, reviews, engineering discipline, and roadmap execution.
- Own runtime delivery deadlines, cross-team coordination, and release quality.
6. Observability, Reliability & Production Excellence
- Instrument the runtime with observability hooks: metrics, tracing, structured logs, and execution heatmaps.
- Build robust retry logic, distributed locks, idempotency guards, and failover strategies.
- Improve runtime stability, throughput, and scale characteristics.
Requirements
Must-Have
- 8+ years of backend engineering experience building high-scale systems.
- 3+ years leading teams focused on workflows, automation, orchestration, or distributed runtimes.
- Deep understanding of:
- Stateful orchestration engines (Temporal, Step Functions, Argo, Airflow)
- Message queues, pub/sub systems, and event-driven patterns
- Retry logic, compensating transactions, and idempotent operations
- Distributed tracing, observability pipelines, and health checks
- Strong background in concurrent programming, async task management, and execution models.
- Hands-on experience with at least one systems language or backend stack (Python, Go, Rust, Node).
Nice-to-Have
- Experience building workflow DSLs or schema-driven interpreters.
- Familiarity with LLM pipelines, agentic runtimes, or AI-driven workflow automation.
- Knowledge of Kubernetes-based runtime environments and workflow controllers.
- Experience with pluggable architecture design, sandboxing, or execution policies.
What This Role Offers
- Ownership of the core execution engine powering Perceive Now’s intelligent automation platform.
- A high-impact leadership position shaping architectural strategy and engineering culture.
- The opportunity to solve cutting-edge problems at the intersection of orchestration, distributed systems, and AI.
Key Responsibilities:
- Design, implement, and maintain scalable, secure, and cost-effective infrastructure on AWS and Azure
- Set up and manage CI/CD pipelines for smooth code integration and delivery using tools like GitHub Actions, Bitbucket Runners, AWS Code build/deploy, Azure DevOps, etc.
- Containerize applications using Docker and manage orchestration with Kubernetes, ECS, Fargate, AWS EKS, Azure AKS.
- Manage and monitor production deployments to ensure high availability and performance
- Implement and manage CDN solutions using AWS CloudFront and Azure Front Door for optimal content delivery and latency reduction
- Define and apply caching strategies at application, CDN, and reverse proxy layers for performance and scalability
- Set up and manage reverse proxies and Cloudflare WAF to ensure application security and performance
- Implement infrastructure as code (IaC) using Terraform, CloudFormation, or ARM templates
- Administer and optimize databases (RDS, PostgreSQL, MySQL, etc.) including backups, scaling, and monitoring
- Configure and maintain VPCs, subnets, routing, VPNs, and security groups for secure and isolated network setups
- Implement monitoring, logging, and alerting using tools like CloudWatch, Grafana, ELK, or Azure Monitor
- Collaborate with development and QA teams to align infrastructure with application needs
- Troubleshoot infrastructure and deployment issues efficiently and proactively
- Ensure cloud cost optimization and usage tracking
Required Skills & Experience:
- 3-4 years of hands-on experience in a DevOps
- Strong expertise with both AWS and Azure cloud platforms
- Proficient in Git, branching strategies, and pull request workflows
- Deep understanding of CI/CD concepts and experience with pipeline tools
- Proficiency in Docker, container orchestration (Kubernetes, ECS/EKS/AKS)
- Good knowledge of relational databases and experience in managing DB backups, performance, and migrations
- Experience with networking concepts including VPC, subnets, firewalls, VPNs, etc.
- Experience with Infrastructure as Code tools (Terraform preferred)
- Strong working knowledge of CDN technologies: AWS CloudFront and Azure Front Door
- Understanding of caching strategies: edge caching, browser caching, API caching, and reverse proxy-level caching
- Experience with Cloudflare WAF, reverse proxy setups, SSL termination, and rate-limiting
- Familiarity with Linux system administration, scripting (Bash, Python), and automation tools
- Working knowledge of monitoring and logging tools
- Strong troubleshooting and problem-solving skills
Good to Have (Bonus Points):
- Experience with serverless architecture (e.g., AWS Lambda, Azure Functions)
- Exposure to cost monitoring tools like CloudHealth, Azure Cost Management
- Experience with compliance/security best practices (SOC2, ISO, etc.)
- Familiarity with Service Mesh (Istio, Linkerd) and API gateways
- Knowledge of Secrets Management tools (e.g., HashiCorp Vault, AWS Secrets Manager)
job Description: Travel Sales Consultant
Location: Gurgaon
Work Mode: Work From Office (WFO)
About the Role
We are looking for a dynamic and customer-focused Travel Sales Consultant to join our team in Gurgaon. The ideal candidate should have strong destination knowledge, hands-on experience in travel sales, and a passion for helping travelers find the perfect group trips and experiences.
Key Responsibilities
- Call and engage with leads generated via the website, WhatsApp, and social media platforms.
- Understand traveler preferences (destination, travel style, budget, dates, etc.) and recommend suitable group trips.
- Coordinate with the Supply Team and known vendors to source GIT Packages & Fixed Departures based on seasonality.
- Work with the Supply and Vendor teams to create rate sheets for destinations to sell to customers.
- Possess strong destination knowledge of Goa, Manali, Thailand, Vietnam, Bali, Ladakh, and Spiti.
- Manage the complete sales cycle—from lead calling, itinerary sharing, follow-ups, and payment collection to handing over final bookings to the Operations and Supply teams.
- Maintain accurate lead details, follow-ups, and conversion records in Google Sheets.
- Achieve monthly sales, conversion, and revenue targets.
- Build long-term relationships with travelers to drive repeat bookings and referrals.
- Promote add-on services such as Elite Membership, travel insurance, and flights whenever relevant.
- Share trip updates, photos, and traveler feedback to support marketing and content teams.
Qualifications & Skills
- Graduate in Travel & Tourism OR
- Minimum 2–3 years of sales experience in the travel domain (mandatory).
- Excellent communication skills in English and Hindi.
- Strong understanding of key travel destinations and group travel dynamics.
- Energetic, target-driven, and passionate about travel and customer engagement.
- Proficient with Google Sheets and basic CRM processes.
Responsibilities:
- Conduct thorough manual testing of software applications across various functionalities.
- Develop and maintain automated test scripts using MSTest framework.
- Identify and report bugs and defects through a bug tracking system.
- Analyze test results, diagnose issues, and collaborate with developers to resolve them.
- Participate in code reviews to identify potential defects early in the development process.
- Stay up-to-date with the latest QA methodologies and best practices.
- Contribute to the improvement of existing testing processes and documentation.
- Work effectively within an Agile development environment.
- Clearly communicate test findings and recommendations to technical and non-technical audiences.
Qualifications:
- Proven experience in manual testing methodologies (e.g., black-box testing, exploratory testing).
- Expertise in developing and maintaining automated test scripts using MSTest.
- Strong understanding of software development lifecycle (SDLC) and Agile methodologies.
- Excellent analytical and problem-solving skills.
- Ability to prioritize tasks, manage time effectively, and meet deadlines.
- Strong written and verbal communication skills.
- Experience with API testing is a plus.
- Familiarity with other automation frameworks (e.g., Selenium) is a plus.
This Role Will Need To Develop A Healthy Knowledge Of The Business Offerings, Services, And Products. Responsibilities Of Candidates Include:
• Meeting With Customers Digitally Or In-Person During Sales Visits
• Develop A Business Strategy To Ensure Area Sales Growth
• Demonstrating And Presenting Products
• Establishing New Business
• Arrange Business Meetings With Prospective Clients
• Generating The Leads
• Maintaining Accurate Records
• Achieve Agreed Upon Sales Targets And Outcomes Within The Schedule
• Look For New Business Opportunities
• Cold Calling Prospects
• Handle Inbound Queries
• May Need To Represent The Company At Events
Knowledge of Hadoop ecosystem installation, initial-configuration and performance tuning.
Expert with Apache Ambari, Spark, Unix Shell scripting, Kubernetes and Docker
Knowledge on python would be desirable.
Experience with HDP Manager/clients and various dashboards.
Understanding on Hadoop Security (Kerberos, Ranger and Knox) and encryption and Data masking.
Experience with automation/configuration management using Chef, Ansible or an equivalent.
Strong experience with any Linux distribution.
Basic understanding of network technologies, CPU, memory and storage.
Database administration a plus.
Qualifications and Education Requirements
2 to 4 years of experience with and detailed knowledge of Core Hadoop Components solutions and
dashboards running on Big Data technologies such as Hadoop/Spark.
Bachelor degree or equivalent in Computer Science or Information Technology or related fields.
- We are looking for candidates who have good programming skills. Strong on data structures, algorithms, understand time space complexity, able to come up with multiple solutions and then arrive at most optimized one keeping in mind customer requirements. Should also be well aware of OO concepts. If he / she has a strong background on these areas ( in any programming language), half the job is done. – 50% weightage
- Next the candidate should have worked on JS with good hands on experience in a few projects mainly in backend development like making api calls, handling exception, models, data transformations, controllers etc. – 20-30% weightage
- The last would be having some experience in any one of react.js/ node.js or even angular.js since some of these are being used in the current project. – 20-30% weightage
- Prefer candidates with Angular (ver 8+), react (ver 16+), Node (Ver 14+) and extremely good in JavaScript, HTML & CSS
- Experience : 4-6 years relevant
Our MEAN stack team is passionate about technology, and we love building scalable web solutions keeping performance in mind.We're looking for a full stack developer that has experience developing a variety of Web Apps using the MEAN stack. You should be able to comfortably move between the client and server-side code written with JavaScript/TypeScript.
Role + Responsibilities:
- Work with the team to design, develop and support scalable applications
- Implementing elegant, intuitive user experience using the latest front-end technologies.
- Developing API's and designing the data architecture using web frameworks like Express.
- Write, test, and release production-ready code.
- Work with our DevOps team to ensure continuous deployments of our applications
Person Specification and Qualifications:
- Experience developing highly scalable services and APIs
- Knowledge of data modelling and database performance using NoSQL/SQL
- Strong experience with JS frameworks like Express(any other backend framework), Angular.
- Familiarity developing SaaS applications in AWS/Azure
- In-depth knowledge of designing and developing software in distributed architectures for multi-tier applications
Plus points if you're familiar with the following:
- Experience with deployment and CI/CD is a plus!
- TypeScript implementation with Frontend or Backend applications
- Knowledge of GraphQL and it's libraries like Apollo, Prisma
- Have worked with Jest, Enzyme like testing libraries
- Knowledge of document, key/value or other non-relational database systems such as Elastic Search, Redis, HBase,







