Data Engineer

We are seeking an experienced MLOps Architect who can drive end-to-end implementation of the proposal being prepared for the initiative and also contribute broadly across other enterprise AI/ML programs. This role demands a strong architectural mindset, hands-on technical depth, and the ability to design scalable, cloud-native machine learning operations across traditional ML and modern LLM workflows.

The ideal candidate will bring experience with SageMaker-based MLOps pipelines, evaluation of equivalent tooling stacks, hybrid MLOps/LLMOps automation, CI/CD orchestration, governance, and production-grade scalability patterns.

Must have skills & Qualifications:

• 8+ years working in ML/AI engineering or MLOps roles with strong architecture exposure.
• Strong expertise in AWS cloud-native ML stack, including: SageMaker(primary), ECS, Lambda, API Gateway, CI/CD (CodeBuild/CodePipeline or equivalent)
• Hands-on experience with at least one major MLOps toolset and awareness of alternatives: MLflow, Kubeflow, SageMaker Pipelines, Airflow, BentoML, KServe, Seldon.
• Deep understanding of model lifecycle management (feature engineering->training -> registry -> deployment -> monitoring).
• Experience implementing or supporting LLMOps pipelines, including: prompt versioning, evaluation metrics, automation frameworks.
• Deep understanding of ML lifecycle: data ingestion, feature engineering, training, evaluation, model packaging, CI/CD, drift detection, monitoring, and governance.
• Strong experience with AWS SageMaker (Pipelines, Feature Store, Model Registry, Model Monitor).
• Experience implementing ML CI/CD pipelines including automated training, testing, validation, model promotion, and endpoint deployment.
• Strong SQL and data transformation experience using Snowflake, Databricks, Spark.
• Experience with feature engineering pipelines and Feature Store management.
• Understanding of lineage tracking: training data snapshot, feature versions, code versioning, metadata tracking, reproducibility.
• Hands-on experience with Bedrock, OpenAI, Anthropic, or Llama models.
• Experience with CloudWatch, SageMaker Model Monitor, Prometheus/Grafana.
• Strong foundation in Python and cloud-native development patterns.
• Solid understanding of security best practices, IAM, secrets management, and artifact governance.

Good to have skills:

• Experience with vector databases, RAG pipelines, or multi-agent AI systems.
• Exposure to DevOps and infrastructure-as-code (Terraform, Helm, CDK).
• Hands-on understanding of model drift detection, A/B testing, canary rollouts, and blue-green deployments.
• Familiarity with Observability stacks (Prometheus, Grafana, CloudWatch, OpenTelemetry).
• Knowledge of Lakehouse (Delta/Iceberg/Hudi) architecture.
• Ability to translate business goals into scalable AI/ML platform designs.
• Strong communication and cross-team collaboration skills.
• Ability to guide engineering teams through technical uncertainty and design choices.

Key Responsibilities:

• Architect and implement the MLOps strategy for the programme, ensuring alignment with the project proposal and delivery roadmap.
• Design and own enterprise-grade ML/LLM pipelines covering model training, validation, deployment, versioning, monitoring, and CI/CD automation.
• Build container-oriented ML platforms (EKS-first) while evaluating alternative orchestration tools with similar capabilities (Kubeflow, SageMaker, MLflow, Airflow, etc.).
• Implement hybrid MLOps + LLMOps workflows, including prompt/version governance, evaluation frameworks, and monitoring for LLM-based systems.
• Serve as a technical authority across multiple internal and customer projects, contributing architectural patterns, best practices, and reusable frameworks.
• Enable observability, monitoring, drift detection, lineage tracking, and auditability across ML/LLM systems.
• Collaborate with cross-functional teams — data engineering, platform, DevOps, and client stakeholders — to deliver production-ready ML solutions.
• Ensure all solutions adhere to security, governance, and compliance expectations, particularly around handling cloud services, Kubernetes workloads, and MLOps tools.
• Conduct architecture reviews, troubleshoot complex ML system issues, and guide teams through implementation across cloud-native ML platforms.
• Mentor engineers and provide guidance on modern MLOps tools, platform capabilities, and best practices. 

Position Overview: The Lead Software Architect - Python & Data Engineering is a senior technical leadership role responsible for designing and owning end-to-end architecture for data-intensive, AI/ML, and analytics platforms, while mentoring developers and ensuring technical excellence across the organization. 

Key Responsibilities: 

• Design end-to-end software architecture for data-intensive applications, AI/ML pipelines, and analytics platforms
• Evaluate trade-offs between competing technical approaches 
• Define data models, API approach, and integration patterns across systems 
• Create technical specifications and architecture documentation 
• Lead by example through production-grade Python code and mentor developers on engineering fundamentals 
• Conduct design and code reviews focused on architectural soundness 
• Establish engineering standards, coding practices, and design patterns for the team 
• Translate business requirements into technical architecture 
• Collaborate with data scientists, analysts, and other teams to design integrated solutions 
• Whiteboard and defend system design and architectural choices 
• Take responsibility for system performance, reliability, and maintainability 
• Identify and resolve architectural bottlenecks proactively 

Required Skills:  

• 8+ years of experience in software architecture and development  
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field 
• Strong foundations in data structures, algorithms, and computational complexity 
• Experience in system design for scale, including caching strategies, load balancing, and asynchronous processing  
• 6+ years of Python development experience 
• Deep knowledge of Django, Flask, or FastAPI 
• Expert understanding of Python internals including GIL and memory management 
• Experience with RESTful API design and event-driven architectures (Kafka, RabbitMQ) 
• Proficiency in data processing frameworks such as Pandas, Apache Spark, and Airflow 
• Strong SQL optimization and database design experience (PostgreSQL, MySQL, MongoDB)  Experience with AWS, GCP, or Azure cloud platforms 
• Knowledge of containerization (Docker) and orchestration (Kubernetes) 
• Hands-on experience designing CI/CD pipelines Preferred (Bonus) 

Skills: 

• Experience deploying ML models to production (MLOps, model serving, monitoring) Understanding of ML system design including feature stores and model versioning 
• Familiarity with ML frameworks such as scikit-learn, TensorFlow, and PyTorch  
• Open-source contributions or technical blogging demonstrating architectural depth 
• Experience with modern front-end frameworks for full-stack perspective

Desired Candidate Profile

• Leveraging your deep knowledge to provide technical leadership to take projects from zero to completion
• Architecting, building and maintaining scalable data pipelines and accessing patterns related to permissions and security
• Researching, evaluating and utilising new technologies/tools/frameworks centred around high-volume data processing
• Involving in building and deploying large scale data processing pipelines in a production environment
• Working with data scientists and other engineers to develop data pipelines for model development and productization
• Identifying gaps and implementing solutions for data security, quality and automation of processes
• Providing inputs on right tool options and model designs for use cases
• Identifying gaps and implementing solutions for data security, quality and automation of processes
• Designing scalable implementations of the models developed by our Data Scientists

Desired Candidate Profile

• 3+ years strong programming experience in PySpark and Python
• Knowledge in Python, SQL, Spark (Pyspark)
• Exposure to AWS/ Azure cloud tools and services like S3 Athena, Apache Nifi, Apache Airflow
• Analytical and problem-solving skills
• Knowledge in Scrum & code sharing Tech: Git, Jira
• Experience related to processing frameworks such as Spark, Spark Streaming, Hive, Sqoop, Kafka etc
• Deep understanding of measuring and ensuring data quality at scale and the required tooling to monitor and optimise the performance of our data pipelines
• Experience building data pipelines and data-centric applications using distributed storage platforms and shipping data production pipelines sourcing data from a diverse array of sources    

Greetings from Gateway Group of Companies!!!

• Expertise in nodeJS and javascript frameworks and languages.
• Good knowledge of npm, Git, MongodB, noSQL, GraphQL, Docker, Webpack,
• Ability to rapidly learn and take advantage of new concepts, business models, and technologies

• Good knowledge of software design patterns and software architecture and design principles
• Processes, Methodology and Tools (Agile),
• Digital Asset Development / Application Development, Support and Maintenance / CICD tools / versioning tools
• Security/Information and Application Protection, Business Analysis
• Experience with CMS platforms
• Knowledge of the Apostrophe platform
• Writing unit tests (mocha, chai, sinon)

•  Development of advanced digital solutions, the Lead Backend developer implements complex technical solutions to conceive custom-tailored applications or to adapt those which already exist. He/she checks the functional quality of the developments and works with the product owner to create or redefine functional specifications. He/she is operational and support the technical team by providing help, and solutions to move forward.

ROLES & RESPONSIBILITIES:

• Responsible for Blockchain evaluation, smart contract development, implementation supporting the digital strategy group initiatives.
• Must have hands-on experience using Solidity.
• Experience in setting up Blockchain nodes and networks.
• Design and develop the architecture of Blockchain Solutions from a systemic standpoint.
• Responsible for creating technical solution architecture for a given business problem.
• Responsible for quality of the application and implements necessary checks and balances via peer review, code scans, automated tests.
• Set the standards for design and development.
• Oversees, maintains,s and supports existing software applications.
• Provide subject matter expertise in reviewing, analyzing, and resolving complex issues.
• Prepare user and systems documentation as needed.
• Design & implement Blockchain solutions which may run on Blockchain platforms and composed of multiple software packages based on Solution Architect.
• Lead a team of Blockchain juniors/trainees.
• Work with product managers and other product teams.
• Well versed in using GitHub.
• Should be flexible to explore different blockchains be it Ethereum, Ripple, Tron, AVA, Multichain, etc

We are looking for experienced and entrepreneurial product leaders with a “co-founder” mindset,to help build and scale a world-class product organization in Bangalore. If you are excited about fintech, zero to one products, working with and learning from a phenomenal team of product,engineering, research, design, operations, and business leaders, this is the role for you.


KEY ACCOUNTABILITIES & RESPONSIBILITIES
- Ideal product manager will be passionate and will deliver an unparalleled customer and user experience
- The product manager would stand for customers and identify key insights from customer research, interviews, surveys etc.
- The product manager will create a strategy and bottom up roadmap with ruthless prioritization to lead an area end to end within the product org
- The product manager will hustle and do whatever it takes to get things done

- Ship fast without sacrificing quality (MVP driven approach); then leverage data and feedback for iterations
- The product manager will own the go to market of the product, will measure the impact of the various products that are launched

- Align key stakeholders on the problem, solution, setting expectation and communicate effectively

- Must be an innovative, strategic thinker and must be able to work in a fast-paced dynamic environment with changing priorities

PROFESSIONAL EXPERIENCE/ QUALIFICATIONS
The ideal candidate profile will be:
- Overall experience of 5+ yrs with at least 3+ yrs in product management in a tech-led company (consumer internet space is preferred)
- Exceptional problem-solving skills based on first principles thinking 

- Have solved complex & ambiguous problem at scale to create significant impact
- Adopt a structured approach to identify what problems need to be solved and break them down into smaller chunks
- Strong analytical and quantitative skills with the ability to use data and metrics to justify requirements, features and drive management of a product.
- Proven ability to deliver first class customer experiences with a deep understanding of UX best practices.
- High attention to detail and proven ability to manage multiple, competing priorities simultaneously with minimal supervision.
- Ability to scale a product post launch and drive adoption, track metrics and plan next steps