
Similar jobs
Experience Level
10+ years of experience in data engineering, with at least 3–5 years providing architectural guidance, leading teams, and standardizing enterprise data solutions. Must have deep expertise in Databricks, GCP, and modern data architecture patterns.
Key Responsibilities
- Provide architectural guidance and define standards for data engineering implementations.
- Lead and mentor a team of data engineers, fostering best practices in design, development, and operations.
- Own and drive improvements in performance, scalability, and reliability of data pipelines and platforms.
- Standardize data architecture patterns and reusable frameworks across multiple projects.
- Collaborate with cross-functional stakeholders (Product, Analytics, Business) to align data solutions with organizational goals.
- Design data models, schemas, and dataflows for efficient storage, querying, and analytics.
- Establish and enforce strong data governance practices, ensuring security, compliance, and data quality.
- Work closely with governance teams to implement lineage, cataloging, and access control in compliance with standards.
- Design and optimize ETL pipelines using Databricks, PySpark, and SQL.
- Ensure robust CI/CD practices are implemented for data workflows, leveraging Terraform and modern DevOps practices.
- Leverage GCP services such as Cloud Functions, Cloud Run, BigQuery, Pub/Sub, and Dataflow for building scalable solutions.
- Evaluate and adopt emerging technologies, with exposure to Gen AI and advanced analytics capabilities.
Qualifications & Skills
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
- Extensive hands-on experience with Databricks (Autoloader, DLT, Delta Lake, CDF) and PySpark.
- Expertise in SQL and advanced query optimization.
- Proficiency in Python for data engineering and automation tasks.
- Strong expertise with GCP services: Cloud Functions, Cloud Run, BigQuery, Pub/Sub, Dataflow, GCS.
- Deep understanding of CI/CD pipelines, infrastructure-as-code (Terraform), and DevOps practices.
- Proven ability to provide architectural guidance and lead technical teams.
- Experience designing data models, schemas, and governance frameworks.
- Knowledge of Gen AI concepts and ability to evaluate practical applications.
- Excellent communication, leadership, and stakeholder management skills.
- Lead the development of the backend systems for our first product
- Build reliable, secure and performant backend systems
- Drive test coverage and continuous delivery automation within the team
- Mentor and provide feedback to teammates
Requirements
- 5+ years of software development experience
- Strong computer science fundamentals
- Deep and wide knowledge of Python ecosystem
- Can write code that is readable, maintainable, secure and performant
- Know the importance of tests and how to approach writing different types of tests
- Good intuition for REST API design
- Deep understanding of relational databases, transactions, entity-relationship modeling
- Comfortable writing highly concurrent systems
- Experienced in using profilers, tuning garbage collection, optimizing SQL queries
Your Opportunity
- Own and drive business features into tech requirements
- Design & develop large scale real time server side systems
- Quickly create quality prototypes
- Staying updated on emerging technologies
- Ensuring that all deliverables adhere to our world class standards
- Promote coding best practices
- Mentor and develop junior developers in the team
Required Experience
- 4+ years of relevant experience as described below
- Excellent grasp of Core Java, Multi Threading and OO design patterns
- Experience with Scala, functional, reactive programming and Akka/Play is a plus
- Excellent understanding of data structures and algorithms
- Solid grasp of large scale distributed real time systems
- Prior experience on building a scalable and resilient micro service
- Solid understanding of relational databases, NoSQL databases and Caching systems
- Good understanding of Big Data technologies such as Spark, Hadoop is a plus
- Experience on one of AWS, Azure or GCP
Who you are
- You have excellent and effective communication and collaborative skills
- You love problem solving
- You stay up to date with the latest technologies and then apply them in real life
- You love paying attention to detail
- You thrive in meeting tight deadlines and prioritising workloads
- Ability to collaborate across multiple functions
Education
Bachelor’s degree in Engineering or equivalent experience within the field
- Minimum of 12 years of Experience with Informatica ETL, Database technologies.
- Experience with Azure database technologies including Azure SQL Server, Azure Data Lake Exposure to Change data capture technology Lead and guide development of an Informatica based ETL architecture.
- Develop solution in highly demanding environment and provide hands on guidance to other team members.
- Head complex ETL requirements and design.
- Implement an Informatica based ETL solution fulfilling stringent performance requirements.
- Collaborate with product development teams and senior designers to develop architectural requirements for the requirements.
- Assess requirements for completeness and accuracy.
- Determine if requirements are actionable for ETL team.
- Conduct impact assessment and determine size of effort based on requirements.
- Develop full SDLC project plans to implement ETL solution and identify resource requirements.
- Perform as active, leading role in shaping and enhancing overall ETL Informatica architecture and Identify, recommend and implement ETL process and architecture improvements.
- Assist and verify design of solution and production of all design phase deliverables.
- Manage build phase and quality assure code to ensure fulfilling requirements and adhering to ETL architecture
You will be a part of: Supply Chain Management (SCM)
Myntra-Jabong Supply Chain Management systems form the backbone of our core business and customer experience. Any business runs on a simple construct of Demand (Consumer) and Supply (Producer). However, a set of complex and intricate methods, processes and systems connect the demand with supply in a deterministic and predictable way. These methods, processes and systems collectively form the Supply Chain for the business. The multi-billion-dollar Myntra-Jabong business fundamentally rests on a set of highly scalable, robust and intelligent Supply Chain Management systems that solve real-world problems of predicting the demand from millions of our customers, for a combination of millions of products from our product catalogue, and intelligently connecting that demand to thousands of national and international sellers or suppliers using a set of advanced homegrown tech products that we build and manage.
SCM engineering employs new-age technologies such as Distributed Computing constructs, Machine Learning, Deep Learning, Computer Vision, Artificial Intelligence; scalable data stores in Mongo, Redis, Cassandra, MySQL, Elastic Search, Solr; scalable programming constructs in Node.js, GoLang, Java; JavaScript, Python, and new-age frameworks such as ReactJS and ReactNative to solve some of the hardest problems in the e-commerce business
with world-class software products.
The SCM engineering at Myntra-Jabong operates within two distinct verticals: Supply-chain Outbound (Fulfilment systems) & Supply-chain Inbound (Selection systems, Partner experience).
Your Responsibilities:
● Own the architecture of Myntra’s new product platforms to drive business results
● Be a visible leader to drive and own the architecture and design of some of the most advanced & complex software systems / products in the industry to create company wide impact.
● Help build, mentor and coach a team of very talented Engineers, Architects, Quality engineers, System Operation Engineers and DevOps engineers in architectural and design best practices.
● Be an operational and technical leader with a passion for distributed systems, cloud service
development, deployment and delivery.
● Be accountable for the design, for the ease of evolution, quality of the systems, performance, scaling, and availability characteristics and limitations of the systems.
● Envision and develop the long-term architectural direction, with emphasis on platforms/ reusable components while adopting a nimble delivery process. Establish structures and processes that ensure a high level of quality and reliability and extensibility of deliverables.
● Drive the creation of next generation extensible web, mobile and fashion commerce platforms, security protocols, customisation and tools to support continuous scaling, internationalization and platform extensions
● Drive code and design reviews of components / systems / products in scope and drives the
architectural governance for them
● Set directional paths for the teams/department for adoption of new technology stacks for solving business problems
● Be a very visible representative of multiple technology domains and represent Myntra in external technical forums
● Work with product management, business stakeholders and other engineering leaders to help define mid-term, long-term roadmaps and shape business directions
● Initiate and deliver leadership training within the engineering organisation, including training new managers, and drive the growth of leaders to create a strong leadership bench
Desired Skills and Experience
● 12 - 16 years of experience in software product development
● Must have a degree in Computer Science or related field
● A solid engineer at heart with excellent abstraction, coding and system design skills
● Proven track record of leading the architecture and delivery in a startup/e-commerce ecosystem within a high growth & matrix environment
● Successfully architected and led technology for consumer-facing products in the global market along with being an efficient proficient problem-solver who envisions business and technical perspectives to develop workable solutions
● Must have exposure to leading product development end-end (portfolio to delivery, re-architectures)
● Strong hands-on technology experience building and running large scale systems handling
multi-million sessions/transactions per day
● Solid experience in large scale Database systems like RDBMS & NoSQL stores
● Strong design/development experience in building massively large scale distributed internet systems and products
● Excellent programming skills in Java/GO and expertise in multi-threading and performance-oriented programming
● Solid experience in Distributed systems, highly scalable products, performance & reliability
● Excellent understanding of processing platforms and queues
● Experience and knowledge of open source software, frameworks and broader cutting edge
technologies around server-side development in Java
● Strong understanding of object-oriented programming, concurrency and fundamentals of
computer-science








