
We have urgent requirement of Data Engineer/Sr Data Engineer for reputed MNC company.
Exp: 4-9yrs
Location: Pune/Bangalore/Hyderabad
Skills: We need candidate either Python AWS or Pyspark AWS or Spark Scala

Similar jobs
We're Hiring: Senior Developer (AI & Machine Learning)** 🚀
🔧 **Tech Stack**: Python, Neo4j, FAISS, LangChain, React.js, AWS/GCP/Azure
🧠 **Role**: AI/ML development, backend architecture, cloud deployment
🌍 **Location**: Remote (India)
💼 **Experience**: 5-10 years
If you're passionate about making an impact in EdTech and want to help shape the future of learning with AI, we want to hear from you!
Position: Python Developer
Location: Andheri East, Mumbai
Work Mode: 5 Days WFO
Availability: Immediate joiners only (or notice period completed)
What We're Looking For:
✅ 2+ years of solid Python development experience
✅ Django framework expertise - must have!
✅ FastAPI framework knowledge - essential!
✅ Database skills in MongoDB OR PostgreSQL
✅ Ready to work from office 5 days a week
At Yugen, we're buildingCansoan AI-agent driven fraud Investigation platform for financial organisations. We're currently in the0-1 stageand we're looking for curious andhigh-agencyengineers to join us in this journey to shape a category defining product with global impact.
You should be eager to learn, prefer a fast-paced environment, and are excited about getting agentic systems to work in production. More importantly, no matter how tough the challenge, you're someone who's never afraid toshow up.
Responsibilities
- Develop, test, and maintain scalable backend systems (APIs, Pipelines and AI applications)
- Work with other team members (Backend, ML, Data Engineers, Product & Design) to ship features quickly
- Learn how to debug & resolve production issues to ensure system uptime
- Participate in architectural & system design discussions
- Explore new technologies and frameworks & come up with suggestions to improve existing systems
Requirements
- Strong programming skills in one or more of: Python, Go, TypeScript or similar
- Strong understanding of software development principles (OOPS, REST APIs, etc. ) and tooling such Git
- Familiarity with databases (SQL or NoSQL)
- A deep sense of curiosity and a knack for experimentation with AI applications
- You're proactive and love getting things done regardless of external factors
- Strong communication skills and a very good eye for detail
Must Have
- Excellent coding skills with strong problem-solving abilities
- Meaningful contributions to open-source projects
- Strong proof of building and deep focus. For example
- Active participation in multiple hackathons, with top-3 finishes or notable wins
- At-least 1 self-driven portfolio project that has been maintained over 4 months. Github repos with frequent commits showing continuous progress would be great.
Must have - Strong python
7+ years of experience with Design, development & architecture.
- Experience in software development with minimum 3 plus years of architecture experience.
- Experience in Core JAVA 8
- Experience in Java J2EE, Microservices
- Experience in Java - Spring, Java - SpringBoot, GCP , Hibernate,JDBC
- Experience in Multi-threading, Performance and Scaling is a plus
- Have used the RDBMS and NoSQL databases like MySQL/Oracle, MongoDB, Cassandra, Neo4J Risk for production ready software’s
- Cloud Native application design experience is a plus
- CICD – Release Pipeline experience
- Experience in application of principles of Architecture Design
- Experience building large scale, high performance distributed systems
- Strong understanding of modern development techniques and processes such as Dev Ops /Cloud
- Promoter of Agile/Scrum, TDD and CI/CD best practices
- Analyzes, designs, programs, debugs and modifies software enhancements and/or new products used in local, networked or Internet-related computer programs. (Code must be used in core version of applications available for sale commercially.)
- Interacts with Delivery managers and/or users to define system requirements and/or necessary modifications.
- Participates in software design meetings and analyzes user needs to determine technical requirements.
- Write technical specifications based on conceptual design and stated business requirements.
- Writes code, completes programming and performs testing and debugging of applications using current programming languages and technologies.
- Completes documentation and procedures for installation and maintenance.
- Trains and communicates with internal Client Training, Client Relationship and Sales teams on systems application.
- May be responsible for developing or executing project plans, budgets and schedules and for documenting work and results.
- May deliver informational and decision-seeking presentations to technical and business groups to internal and/or external audiences.
- Optimizing components for maximum performance across a vast array of web-capable devices and browsers
- Ability to understand business requirements and translate them into technical requirements
- You will ensure that these components and the overall application are robust and easy to maintain.
- Have a good understanding of design and user experience principles.
- Open-minded, flexible, and willing to adapt to changing situations
- Ability to work independently as well as on a team and learn from colleagues
- High adaptability in a dynamic start-up environment
- Ensuring technologies are used efficiently, profitably, and securely. Evaluating and implementing new systems and infrastructure.
- Excellent troubleshooting, analytical and problem-solving abilities with a tenacious commitment to finding the root cause of issues.
Qualifications :
- B. Tech/ B.E. /M. Tech/ BCA / MCA or a related technical discipline from reputed universities
Skills Required :
- Minimum 2+ years of experience in REST API development using python.
- Must have experience with anyone popular python frameworks like Django, Flask, and FastAPI Framework.
- Experience in designing and developing Restful Web services and Remote procedure calls.
- Able to integrate multiple data sources and databases into one system
- Knowledge of load testing and optimizing code for performance, security, and scalability
- Experience with Unit testing frameworks in Python
- Knowledge of modern authorization & authentication mechanisms.
- Able to create database schemes that represent and support business processes
- Knowledge of Version Control System & basics of CI/CD
- Write and maintain technical documentation
- Solid foundation in OOPS, Data structures, and Algorithms
- Knowledge of SDLC phases of project development.
- Experience in one or more No SQL Databases such as MongoDB, and Cassandra.
- Experience with event-based databases and programming
- Good experience in synchronous programming and thread-based programming.
- Experience with schedulers.
- Good to have knowledge of Linux shell commands.
- Good to have experience in Kubernetes & Docker
- Knowledge of any Cloud Service like GCP or AWS would be an added advantage
- Cares deeply about writing Quality, Testable & Modular code
- Good to have an understanding of NLP.
Building highly-scalable and secure payments platform
Primary owners of one or more components of the platform and will drive innovation in
your area of ownership
Working with various product teams gathering requirements and adding capabilities
Working with some of the smartest people in the industry and will have ample opportunity to learn and grow
Using cutting-edge cryptography to secure payments beyond industry standards
Deriving actionable insights by mining TBs of data
Building a low-level infrastructure that aims to push the boundaries of network
performance
Participating actively in recruitment and nurturing of engineers as awesome as you
What do we look for?
Review and influence new evolving design, architecture, standards and methods with
stability, maintainability, and scale in mind
Identify patterns and provide solutions to class of problems
Research, evaluate and socialize new tools, technologies, and techniques to improve the value of the system
Be able to multitask, prioritize and handle dependencies with minimal oversight
From a technology perspective, you should have the knowledge and/or experience in a
reasonably sized subset of the following ( the more, the merrier!! )
Worked on one or more large scale java applications
Good understanding of nuances of distributed systems, scalability, and availability
Good knowledge of one or more relational and NoSQL databases and transactions
Shrewd focus on latency and throughput of services
In-depth understanding of concurrency, synchronization, NIO, memory allocation and GC
Experience with IaaS clouds like AWS/Google Cloud, Azure, OpenStack etc..
Experience in working with Message Brokers and Application Containers
Great ability to mentor and train other team members
• Build out our web architecture allowing new feature modules to be sent to production, while having
strategic foresight on long term product vision.
• Software development project management from transforming requirements into technical specifications,
design, code, and tested systems.
• Closely involved in development life cycle right from concept stage to delivery and post- launch support.
• Keep abreast of new trends and best practices in web development and explore new technologies.
• Document the development process, architecture, and standard components.
• Coordinate with co-developers and actively participate in code reviews , bug fixing code /architecture.
• Brainstorm and solve problems and put effort in constant improvement in technical front .
• Perform frequent peer reviews.
• Participate actively in demos / S&T.
• Share knowledge through collaboration, training, peer review, presentations, and articles.
• Track record of delivering in Scrum, Agile and other methodologies.
• Proficiency in establishing processes and tools to enable team productivity when developing websites
(version control, automatic build, code review).
• Strong verbal and written communication skills and cognitive ability.
• Contribute towards a positive healthy fun and creativity driven culture.
Must Have:
• Strong aptitude towards problem solving with a hacker mindset.
• Should have infinite love towards Linux and respect open-source development.
• Should have sound knowledge of core PHP, MVC Frameworks Laravel preferred.
• Familiarity with limitations of PHP as a platform and its workarounds.
• Should be excellent in SQL/NoSql database (Surprise us we are constantly pushing out DB architecture).
• Basic Knowledge of Frontend Technologies to easily communicate in terms of Front end Lingos.
• Experience with Agile development methodologies.
• Experience in building high secure components, encryption techniques.
• Experience in building event based and queue based Infrastructure.
• Experience with multi-tier system and service design and development for large scale systems.
• Extensive, real-world experience designing technology components for enterprise solutions and defining
solution architectures and reference architectures with a focus on cloud technologies.
• Passion for best design and coding practices and a desire to develop new bold kickass ideas.
• Experience with caching and scaling techniques.
• Experience with cloud infrastructure is must AWS/GCP/DO.
• Good to have experience with any tool such as Jenkins, Gitlab Devops building pipelines, CI/CD automation.
• Eager to learn new languages and experiment / explore new technologies.










