Senior Lead Software Developer at Appiness Interactive · Remote only · 6 - 10 years · ₹10L - ₹14L / yr · Remote only · Posted 15 Dec 2025

Position Overview: The Lead Software Architect - Python & Data Engineering is a senior technical leadership role responsible for designing and owning end-to-end architecture for data-intensive, AI/ML, and analytics platforms, while mentoring developers and ensuring technical excellence across the organization.
Key Responsibilities:
- Design end-to-end software architecture for data-intensive applications, AI/ML pipelines, and analytics platforms
- Evaluate trade-offs between competing technical approaches
- Define data models, API approach, and integration patterns across systems
- Create technical specifications and architecture documentation
- Lead by example through production-grade Python code and mentor developers on engineering fundamentals
- Conduct design and code reviews focused on architectural soundness
- Establish engineering standards, coding practices, and design patterns for the team
- Translate business requirements into technical architecture
- Collaborate with data scientists, analysts, and other teams to design integrated solutions
- Whiteboard and defend system design and architectural choices
- Take responsibility for system performance, reliability, and maintainability
- Identify and resolve architectural bottlenecks proactively
Required Skills:
- 8+ years of experience in software architecture and development
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
- Strong foundations in data structures, algorithms, and computational complexity
- Experience in system design for scale, including caching strategies, load balancing, and asynchronous processing
- 6+ years of Python development experience
- Deep knowledge of Django, Flask, or FastAPI
- Expert understanding of Python internals including GIL and memory management
- Experience with RESTful API design and event-driven architectures (Kafka, RabbitMQ)
- Proficiency in data processing frameworks such as Pandas, Apache Spark, and Airflow
- Strong SQL optimization and database design experience (PostgreSQL, MySQL, MongoDB) Experience with AWS, GCP, or Azure cloud platforms
- Knowledge of containerization (Docker) and orchestration (Kubernetes)
- Hands-on experience designing CI/CD pipelines Preferred (Bonus)
Skills:
- Experience deploying ML models to production (MLOps, model serving, monitoring) Understanding of ML system design including feature stores and model versioning
- Familiarity with ML frameworks such as scikit-learn, TensorFlow, and PyTorch
- Open-source contributions or technical blogging demonstrating architectural depth
- Experience with modern front-end frameworks for full-stack perspective

About Appiness Interactive
About
Company social profiles
Similar jobs (10)
Technical Architect – Product Engineering
Experience: 15+ Years
Location: Pune, India
Employment Type: Full-time
Desired Skills: Python, Technical Architecture, AWS, Microservices, SaaS / Multi-tenant Architecture, Kubernetes, System Design
About the Role
We are looking for a Senior Technical Architect to lead the architecture, design, and technical evolution of an enterprise SaaS product. This is a hands-on leadership role requiring deep technical expertise, strong product engineering experience, and the ability to build scalable, secure, and high-performance platforms.
The ideal candidate should be passionate about solving complex engineering problems, driving innovation, mentoring development teams, and effectively leveraging AI to accelerate software development.
Key Responsibilities
- Own the overall product architecture and technical roadmap.
- Design and build scalable, secure, and highly available enterprise applications.
- Lead the design and implementation of new product features from concept to production.
- Remain hands-on with coding and contribute to critical product components.
- Drive architecture reviews, code quality, performance optimization, and engineering best practices.
- Lead cloud architecture, security, scalability, and DevOps initiatives.
- Evaluate and adopt modern technologies to improve product capabilities and engineering efficiency.
- Leverage AI tools (ChatGPT, GitHub Copilot, Cursor, Claude, etc.) to accelerate software development, code reviews, testing, documentation, debugging, and productivity.
Required Skills & Qualifications
- 15+ years of software product engineering experience with at least 5 years in a Technical Architect role.
- Strong hands-on expertise in Python and modern backend frameworks.
- Deep experience with AWS services and cloud-native application architecture.
- Strong understanding of DevOps, CI/CD pipelines, Infrastructure as Code (Terraform/CloudFormation), Docker, Kubernetes, and container orchestration.
- Experience designing microservices, REST APIs, event-driven architectures, and distributed systems.
- Strong knowledge of SQL and NoSQL databases.
- Experience with scalable SaaS platforms, multi-tenant architectures, and secure application design.
- Excellent understanding of software design patterns, performance tuning, observability, and system reliability.
- Strong analytical, problem-solving, and decision-making skills.
About the Role
We are seeking a hands-on Tech Lead to design, build, and integrate AI-driven systems that automate and enhance real-world business workflows. This is a high-impact role for someone who enjoys full-stack ownership — from backend AI architecture to frontend user experiences — and can align engineering decisions with measurable product outcomes.
You will begin as a strong individual contributor, independently architecting and deploying AI-powered solutions. As the product portfolio scales, you will lead a distributed team across India and Australia, acting as a System Integrator to align engineering, data, and AI contributions into cohesive production systems.
Example Project
Design and deploy a multi-agent AI system to automate critical stages of a company’s sales cycle, including:
- Generating client proposals using historical SharePoint data and CRM insights
- Summarizing meeting transcripts
- Drafting follow-up communications
- Feeding structured insights into dashboards and workflow tools
The solution will combine RAG pipelines, LLM reasoning, and React-based interfaces to deliver measurable productivity gains.
Key Responsibilities
- Architect and implement AI workflows using LLMs, vector databases, and automation frameworks
- Act as a System Integrator, coordinating deliverables across distributed engineering and AI teams
- Develop frontend interfaces using React/JavaScript to enable seamless human-AI collaboration
- Design APIs and microservices integrating AI systems with enterprise platforms (SharePoint, Teams, Databricks, Azure)
- Drive architecture decisions balancing scalability, performance, and security
- Collaborate with product managers, clients, and data teams to translate business use cases into production-ready systems
- Mentor junior engineers and evolve into a broader leadership role as the team grows
Ideal Candidate Profile
Experience Requirements
- 5+ years in full-stack development (Python backend + React/JavaScript frontend)
- Strong experience in API and microservice integration
- 2+ years leading technical teams and coordinating distributed engineering efforts
- 1+ year of hands-on AI project experience (LLMs, Transformers, LangChain, OpenAI/Azure AI frameworks)
- Prior experience in B2B SaaS environments, particularly in AI, automation, or enterprise productivity solutions
Technical Expertise
- Designing and implementing AI workflows including RAG pipelines, vector databases, and prompt orchestration
- Ensuring backend and AI systems are scalable, reliable, observable, and secure
- Familiarity with enterprise integrations (SharePoint, Teams, Databricks, Azure)
- Experience building production-grade AI systems within enterprise SaaS ecosystems
This is a remote position.
About Leegality:
Leegality works with large Indian businesses to digitally transform critical compliance processes in a fast, easy and secure way.
We have multiple products across 2 categories:
Document Infrastructure:
Products that help businesses build paperless processes at scale:
- Document Execution Workflow: A unified platform for businesses to digitally execute (eSign, eStamp, Template Pre-fill, Document Fraud Prevention etc.) agreements, forms and other documents in a compliant way. Currently in use by 2000+ Indian businesses from giants like HDFC and SBI Cards to high-growth disruptors like goDigit and Cars24.
- Contract Management: An AI-powered platform for businesses to quickly review, negotiate and take action on contracts
- Signstation: A simple platform for businesses to digitally sign simple documents like invoices, policies and letters in a cost effective manner
Consent Infrastructure:
- Consentin: An end-to-end DPDP and Privacy compliance platform for Indian businesses
- Consentin Lens: A data discovery platform for businesses to identify the personal data they collect and store.
If you’re interested in building mission critical software that operates at population scale (75 million + Indians have signed at least one document through Leegality) then join Leegality.
Curious about our impact? Explore our customer success stories: leegality.com/case-studies
Our Culture
At Leegality, trust, ownership, transparency, and having fun while doing meaningful work are core to how we operate — not just values on paper. Our team rated us an incredible 97 eNPS for FY 2023–24 — the highest among 175+ startups surveyed.
We focus deeply on helping our people grow and stay motivated. Some of the perks you’ll enjoy:
- Flexible working hours
- Hybrid work setup
- Bi-annual performance appraisals
- A culture that rewards initiative, curiosity, and impact
If you're looking for a place where you can make a real difference while working with smart, driven, and genuinely nice people, welcome to Leegality.
Location: Hybrid
Role Overview
We are looking for a Technical Lead – Python to lead the design, development, and evolution of scalable backend systems that power Leegality's products. This role combines hands-on backend development with technical leadership, enabling you to influence architecture, mentor engineers, and drive engineering excellence across the team.
You will work closely with Product, Design, QA, DevOps, and other engineering teams to build reliable, secure, and high-performance applications while fostering a culture of ownership, collaboration, and continuous improvement.
Key Responsibilities
- Lead the design, development, and maintenance of scalable backend applications using Python.
- Own the technical architecture of backend systems, ensuring scalability, reliability, maintainability, and security.
- Design, develop, and optimize RESTful APIs and microservices for high-performance applications.
- Drive architectural decisions, establish engineering best practices, and promote clean, maintainable code.
- Conduct code reviews and mentor engineers through technical guidance, pair programming, and knowledge sharing.
- Lead technical estimation, sprint planning, solution design, and execution for engineering initiatives.
- Optimize application performance through database tuning, caching, asynchronous processing, and efficient system design.
- Ensure high code quality through unit testing, integration testing, CI/CD pipelines, and automated deployment practices.
- Troubleshoot and resolve complex production issues while driving root cause analysis and long-term improvements.
- Evaluate and adopt new technologies, frameworks, and engineering practices to continuously improve the platform.
- Build and foster a high-performing engineering culture focused on collaboration, accountability, innovation, and continuous learning.
Desired Skills
- 7–11 years of experience in backend software development, with at least 2–4 years in a technical leadership role.
- Strong proficiency in Python and object-oriented programming concepts.
- Hands-on experience with Python frameworks such as Django, Flask, or FastAPI.
- Strong understanding of RESTful API design and development, authentication mechanisms (JWT/OAuth), and API security best practices.
- Experience designing scalable backend architectures, distributed systems, and microservices.
- Strong knowledge of relational databases such as MySQL or PostgreSQL, with experience in query optimization, indexing, and schema design.
- Exposure to NoSQL databases such as MongoDB and caching technologies like Redis.
- Experience with cloud platforms such as AWS, containerization using Docker, orchestration using Kubernetes, and CI/CD pipelines.
- Strong understanding of software engineering best practices, including design patterns, SOLID principles, code reviews, testing, and documentation.
- Experience with version control systems such as Git and modern development workflows.
- Excellent analytical, problem-solving, communication, and stakeholder management skills.
- Ability to balance hands-on development with technical leadership and delivery ownership in a fast-paced product environment.
- Experience working in SaaS or product-based organizations is preferred.
- Exposure to AI-assisted development tools such as GitHub Copilot, Cursor, or ChatGPT is an added advantage.
Key Responsibilities:
· Architectural Leadership: Design and lead the development of robust, scalable AI architectures, ensuring high performance, reliability, and security.
· Applied Mathematics & Statistics: Apply statistical analysis, numerical computation, and mathematical modeling to derive insights from large-scale data and optimize model performance.
· Deep Learning Development: Design, train, and deploy advanced Deep Learning (DL) models.
· Technical Mentorship: Mentor engineering teams on best practices for AI/ML, coding standards, and architectural design.
· Model Optimization: Optimize models for speed, efficiency, and accuracy using techniques like pruning, quantization, or GPU acceleration.
· Strategy & Innovation: Evaluate and select appropriate AI frameworks, tools, and platforms, staying abreast of cutting-edge research and industry trends.
Qualifications:
Required:
· Education: Master's or PhD in Computer Science, Applied Mathematics, Statistics, Physics, or a related quantitative field.
· Experience: 10+ years of experience in software development, with at least 3-5 years in a Applied Mathematics and Deep learning.
· AI/ML Expertise: Proven experience designing and deploying deep learning models in production using frameworks.
· Mathematics/Statistics: Strong proficiency in linear algebra, calculus, probability, and statistical methods.
· Programming Skills: Expert-level coding skills in Python (NumPy, Pandas, Scikit-learn) and experience with languages like Java or C++.
Key Competencies:
- Strategic mindset with deep operational awareness.
- Excellent communication and stakeholder management skills.
- Ability to simplify complex technical concepts for executive reporting.
- Strong leadership, people development, and cross-functional influencing skills.
Bias for action and a relentless focus on continuous improvement.
Job Description: Python + AI
Company: Wissen Technology
Location: Bangalore, India
Experience: 5+Years
Employment Type: Full-Time
Role: Python + AI / Data Engineer
About the Role
Wissen Technology is looking for experienced Python + AI / Data Engineering professionals to join our technology team in Bangalore. The ideal candidate will have strong hands-on experience in Python, Artificial Intelligence, Generative AI, PySpark, Snowflake, and data pipeline development.
The candidate should be capable of designing and developing scalable data and AI solutions, building robust ETL/ELT pipelines, working with large datasets, and integrating AI/ML capabilities into enterprise applications.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python and PySpark.
- Develop robust ETL/ELT pipelines for processing large volumes of structured and unstructured data.
- Build and optimize data processing solutions using Apache Spark / PySpark.
- Develop data ingestion and transformation pipelines into Snowflake.
- Design and implement scalable Snowflake data models, tables, views, and SQL transformations.
- Work with batch and, where applicable, real-time data processing pipelines.
- Build and integrate AI and Generative AI solutions using Python.
- Develop LLM-based applications, RAG solutions, AI agents, and AI-powered services.
- Integrate AI models with enterprise data platforms and data pipelines.
- Develop REST APIs and microservices using FastAPI, Flask, or Django.
- Perform data cleansing, transformation, validation, and quality checks.
- Optimize PySpark jobs, SQL queries, Snowflake workloads, and data pipelines for performance and scalability.
- Implement data pipeline monitoring, logging, error handling, and alerting.
- Work with cloud platforms such as AWS, Azure, or GCP.
- Collaborate with Data Scientists, Data Engineers, Software Engineers, Architects, and business stakeholders.
- Participate in technical design, architecture, code reviews, and production support.
- Mentor junior engineers and contribute to engineering best practices.
Preferred Qualifications
- Bachelor's or master's degree in computer science, Engineering, Data Science, Artificial Intelligence, or a related field.
- Experience working on enterprise-scale AI and data engineering projects.
- Experience combining Python + PySpark + Snowflake + AI/GenAI in production environments.
- Experience with Databricks is an advantage.
- Experience with AI Agents / Agentic AI and tool/function calling.
- Knowledge of distributed systems and cloud-native architecture.
- Experience leading technical initiatives or mentoring engineering teams.
Sr. Technology Architect
Experience Range: 12–15+ years of IT experience, including 3–5+ years in leadership / people management roles.
Location: Chennai, Hyderabad, Bangalore
Qualification: B. Tech /B.E in computer science or equivalent
Minimum 10+ years of experience in Advanced Java
At least 2+ years of experience for the following areas:
- Lead and mentor full-stack development teams across multiple projects and workstreams.
- Define technical architecture, coding standards, and development best practices.
- Drive end-to-end delivery of enterprise applications using Agile methodologies.
- Oversee application design, development, testing, deployment, and production support.
- Ensure adherence to security, performance, quality, and compliance standards.
- Collaborate with clients, product owners, architects, and cross-functional teams.
- Manage resource planning, risk mitigation, technical reviews, and stakeholder communication.
- Promote DevOps, CI/CD, and automation practices to improve delivery efficiency
Must Haves-
- Strong experience in Java Full Stack Development.
- Expertise in Spring Boot and Microservices Architecture.
- Proficiency in Python, Shell Scripting, and backend development.
- Hands-on experience with SQL, Oracle, and PostgreSQL databases.
- Front-end expertise in React, Angular, HTML5, CSS3, Bootstrap, and JSP.
- Experience with Kafka or similar event-driven messaging platforms.
- Strong understanding of API Design, REST Services, and Swagger/OpenAPI.
- Experience implementing security frameworks including OAuth 2.0.
- Hands-on expertise with Jenkins, CI/CD pipelines, and DevOps practices.
- Experience with code quality and security tools such as SonarQube and Fortify.
- Proven people management, stakeholder management, and delivery leadership experience.
- Experience working in Agile/Scrum environments.
Good to Haves-
- Experience with cloud platforms (AWS, Azure, or GCP).
- Knowledge of containerization and orchestration technologies such as Docker and Kubernetes/OpenShift.
- Experience with performance tuning, observability, and application monitoring tools.
- Telecom, OSS/BSS, or enterprise digital transformation domain experience.
- SAFe Agile, PMP, Scrum Master, or cloud certifications.
- Exposure to AI-assisted development tools and engineering productivity platforms.
About the Role
We are looking for a Senior Data Engineer with strong hands-on expertise in Databricks, Python, PySpark, and SQL to build scalable, high-performance data engineering solutions. You’ll architect and develop large scale, high-performance data pipelines capable of handling massive real-time and batch data volumes across multiple business systems. Databricks is the core enterprise data and processing platform for this role. You will also use Apache Airflow for workflow orchestration and dbt for ELT transformations, and will contribute to designing reliable, secure, and governed data platforms that enable analytics, reporting, and AI-driven use cases.
Key Responsibilities
- Design and implement large-scale data pipelines using Python/PySpark, Databricks, and Microsoft Fabric.
- Develop and optimize data processing workloads in Databricks using PySpark and Spark SQL, with a strong focus on scalability, reliability, performance, and maintainability.
- Develop and maintain dbt models including layered architecture, incremental models, snapshots, macros, testing, and documentation.
- Design, develop, and maintain Apache Airflow DAGs for orchestrating reliable, scalable, and observable data pipelines.
- Design and implement data quality, observability, and governance frameworks, including automated testing, monitoring, lineage, access control, and data privacy standards.
- Partner with analytics, product, and business stakeholders to turn requirements into trustworthy datasets, and raise the engineering bar through design discussions, code reviews, and mentoring junior engineers.
Required Skills
- Strong expertise in Python for developing scalable, modular, and production-ready data engineering applications.
- Strong expertise in PySpark, including DataFrame API, Spark SQL, Structured Streaming, partitioning strategies, joins, caching, handling data skew, and Spark performance optimization.
- Strong hands-on experience with Databricks for data ingestion, transformation, processing, and optimization, including Delta Lake, Unity Catalog, Databricks Workflows, notebooks, jobs, and Databricks-native data engineering capabilities.
- Strong experience in Databricks/Spark performance tuning, including query and job optimization, partitioning, file sizing, caching, join optimization, handling data skew, and efficient use of compute resources.
- Hands-on experience with Delta Lake, including transactional data processing, schema management, incremental data processing, and reliable batch and streaming data pipelines.
- Hands-on experience in developing dbt projects using layered architecture, incremental models, snapshots, macros/Jinja, testing, documentation, and deployment best practices.
- Expertise in advanced SQL and data modelling — dimensional modeling, slowly changing dimensions, schema evolution, and query optimization.
- Hands-on experience in developing and managing Apache Airflow DAGs, scheduling workflows, dependency management, retries, backfills, and operational monitoring.
- Hands-on experience with at least one major cloud platform (AWS, Azure or GCP).
- Strong problem-solving skills and the ability to work independently with business and analytics stakeholders.
Nice to Have
- Hands-on exposure to Microsoft Fabric for data integration and analytics.
- Experience using AI coding assistants (e.g. Claude Code, GitHub Copilot) as part of a development workflow.
- Familiarity with modern DevOps practices, including CI/CD pipelines, Infrastructure as Code (IaC), and containerization (Docker/Kubernetes).
- Domain expertise in financial services.
Location: Hyderabad, India. Based at the KnackLabs headquarters, with occasional travel to client locations for workshops and reviews. This role does not involve extended onsite deployments.
About the Role
You will work as an AI Architect who designs the systems behind our client engagements: AI agents, RAG systems, automation platforms, and the conventional backend systems around them.
This is a hands-on design role, not a slideware role. You will scope architectures with clients, make the hard technical decisions, defend them in review, and stay accountable for how the systems perform in production.
You will work directly with clients. Everyone at KnackLabs does. You will sit in design discussions with client engineering teams, present architecture decisions to technical and business stakeholders, and answer for the choices you make.
A full KnackLabs engineering team in Hyderabad builds with you. You own the technical design and the quality of what ships.
What you'll own
- Architecture - Design AI agents, RAG systems, integrations, and the scalable backend systems around them, for multiple client engagements.
- Technical scoping - Work directly with clients to turn a business problem into a system design, with clear trade-offs and clear reasons.
- Scale and reliability - Make sure what we build handles real load: data stores, queues, caching, horizontal scaling, and fault tolerance.
- Design reviews - Review designs and builds across engagements. Set the technical bar and hold it.
- Evaluation strategy - Define how we measure accuracy, safety, latency, and cost for the AI systems we ship.
- Guiding engineers - Raise the level of the engineers building with you, through reviews and direct pairing.
- Feedback to the platform - Feed what you learn across engagements back into our platform and internal tools.
What we are looking for
- Around 7 or more years of software engineering experience, including direct work with customers on design or delivery.
- Full-stack development experience with strength in backend technologies.
- Experience designing and building scalable applications. You understand how large-scale distributed systems work: data partitioning, queues, caching, horizontal scaling, and fault tolerance.
- At least 2 years of strong, hands-on AI experience with large language models in production.
- You build with AI coding tools like Claude Code or Codex as your default way of working. You understand Claude Skills, have written skills yourself, use them actively, and have contributed to them.
- Hands-on experience building retrieval-augmented generation (RAG) systems: chunking, embeddings, vector databases, retrieval, and reranking.
- Hands-on experience building AI agents.
- Strong programming skills in Python. Working knowledge of TypeScript or JavaScript.
- Experience with at least one cloud platform (AWS, Azure, or GCP).
- Clear communication. You can explain an architecture decision to an engineer and to a business leader, and defend it under questioning.
- High ownership and comfort with ambiguity. You can take an unclear problem and turn it into a design.
Nice to have
- Experience building evaluations to measure accuracy, safety, latency, and cost.
- Experience with observability and tracing tools such as LangSmith or Braintrust.
- Experience with on-premises or private cloud (VPC) deployments.
- Experience deploying AI systems in regulated industries such as insurance, banking, or the public sector.
- Experience with data engineering and pipelines.
- A history of side projects, open source contributions, or products you shipped end-to-end.
- Experience working at a consulting or professional services firm in a client-facing delivery role.
Stack and tools
- Languages: Python and TypeScript.
- Models: Claude and other frontier or open-source models, chosen to fit the customer.
- AI patterns: RAG, agents, prompt engineering, skills, and evaluations.
- Vector and retrieval: vector databases and retrieval pipelines.
- Cloud: AWS, Azure, or GCP, on public or private cloud.
- Integration: REST APIs and enterprise system connectors.
Solution Architect – AZURE Data Engineering
Job Overview
We are looking for an experienced Solution Architect – Data Engineering with strong expertise in designing data solutions and hands-on experience with Azure, Synapse, PySpark, Data Warehousing, and Data Lakes. The ideal candidate should have strong architectural and data engineering knowledge.
Key Responsibilities
- Design and implement scalable data architecture and solutions.
- Develop and manage Data Warehouse and Data Lake architectures.
- Design data platforms using Medallion Architecture.
- Lead Data Engineering and ETL activities.
- Work with Azure Synapse Analytics for data processing and analytics.
- Develop data solutions using PySpark / Apache Spark.
- Define and implement data validation and data quality processes.
- Collaborate with business, data, and technology teams to deliver effective data solutions.
Required Skills
- Strong experience in Solution Architecture / Data Architecture.
- Strong knowledge of Data Warehouse and Data Lake architecture.
- Good understanding of Medallion Architecture.
- Strong experience in Data Engineering and ETL.
- Hands-on experience with Microsoft Azure and Azure Synapse Analytics.
- Strong knowledge of PySpark / Apache Spark.
- Experience with Data Validation and Data Quality.
- Good communication and stakeholder management skills.
Experience
8+ Years
Job Description:
Position: Lead / Senior Data Engineer
Location: Chennai
Shift: US Eastern Time ( 5:00 PM – 2:00 AM )
Experience : 8+ years
Notice Period: Immediate Joiner only
Roles and Responsibilities:
Role Overview
The Lead Data Engineer will be responsible for designing, developing, and delivering high-quality software and data solutions while leading a team of engineers. The role involves hands-on technical work, architectural decision-making, mentoring junior developers, and collaborating with cross-functional teams to ensure successful delivery of scalable data platforms and analytical solutions.
Key Responsibilities:
Lead the end-to-end design, development, and delivery of software systems, data pipelines, and components.
Define technical strategy, architecture, and best practices for development and data engineering.
Design and build optimized data pipelines using cutting-edge technologies in a cloud environment.
Construct infrastructure for efficient ETL processes from various sources and storage systems.
Architect, design, and maintain database pipeline architectures, ensuring readiness for AI/ML transformations.
Lead the implementation of algorithms and prototypes to transform raw data into useful information.
Review code for quality, scalability, and performance.
Collaborate with Product Managers, Business Managers, Designers, and QA teams to translate business requirements into technical solutions.
Develop analytical tools, programs, and reporting mechanisms.
Create data validation methods and data analysis tools.
Interpret data trends and patterns to establish operational alerts.
Conduct complex data analysis and present results effectively.
Prepare data for prescriptive and predictive modeling.
Ensure compliance with data governance and security policies.
Troubleshoot, debug, and resolve complex technical issues.
Drive continuous improvement in software and data development processes, tools, and methodologies.
Mentor and guide engineers through code reviews, technical discussions, and training.
Ensure timely delivery of projects while maintaining high engineering standards.
Continuously explore opportunities to enhance data quality and reliability.
Apply strong programming and problem-solving skills to develop scalable solutions.
Demonstrate passion for testing strategy, problem-solving, and continuous learning.
Willingness to acquire new skills and knowledge.
Possess a product/engineering mindset to drive impactful data solutions.
Experience working in distributed environments with global teams.
Stay current with emerging technologies and industry trends to propose innovative solutions.
Technical Skills and Experience Requirements
Minimum 8+ years of hands-on experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable, resilient, and distributed data pipelines.
High proficiency in Python, Scala, and Spark for applied large-scale data processing.
Expertise with big data technologies, including Spark, Data Lake, Delta Lake, and Hive.
Solid understanding of batch and streaming data processing techniques.
Proficient knowledge of the Data Lifecycle Management process, including data collection, access, use, storage, transfer, and deletion.
Expert-level ability to write complex, optimized SQL queries across extensive data volumes.
Experience with RDBMS and OLAP databases such as MySQL and Snowflake.
Familiarity with Agile methodologies.
Obsession for service observability, instrumentation, monitoring, and alerting.
Knowledge or experience in architectural best practices for building data lakes.
Qualifications - Bachelor’s degree in computer science, Engineering, Information Systems, or related field.






