PHP Developer

4 - 10 years of experience in designing and buildingarchitecting highly resilient data platforms 

∙Strong knowledge of data engineering, architecture and data modeling 

∙Experience in platforms like Databricks and Snowflake 

∙Experience on building applications on cloud (AWS or Azure or Google Cloud) 

∙Strong analytical and problem-solving skills 

∙Prior experience in developing data or computation intensive (e.g. grid based) backend applications is an 

advantage 

∙OOP design skills with an understanding or at least personal interest towards the concepts of Functional 

Programming  

∙Willingness to understand and enhance other people’s code, being able to work in an environment where 

developers will oversee and work on wider components also dealing with older “legacy” code 

∙Strong programming skills (Java/ Scala / Python) skills with the willingness to pick up the other language if not 

already mastered at a sufficient level is important 

∙Spring knowledge is an advantage, but in general willingness to learn, work with and even enhance in-house 

developed frameworks is a must 

∙Prior experience in working with Git, Bitbucket, Jenkins, working with PR-s, using JIRA, following the Scrum Agile 

methodology is an advantage 

∙Prior knowledge of financial products is an advantage 

∙Bachelors or Masters in any relevant field of IT/Engineering area is an advantage  

About the role

You will be a pivotal member of the leadership team, responsible for driving the company's product and platform strategy while overseeing engineering excellence across AI, data, platform, DevOps and infrastructure. This is a mission-critical role for an engineering leader who is both strategic and hands-on, and who can build scalable technologies for global enterprise clients in a fast-paced innovation ecosystem.

Reports to: CEO · Location: Bengaluru, India — hybrid, 3 days a week in office

What you will do

Technology & product leadership

• Define and drive the technology vision, architecture and long-term platform roadmap.
• Oversee the architecture, design and delivery of highly scalable enterprise systems.
• Ensure engineering excellence, velocity and reliability across the product lifecycle.

Engineering & platform management

• Lead platform engineering, product technology, DevOps, infrastructure and Quality Engineering.
• Build robust cloud-native systems using the Azure, AWS and GCP ecosystems.
• Oversee operational effectiveness, including uptime, production reliability and cost optimisation.

Innovation & AI strategy

• Spearhead Mission AI by developing scalable, production-grade AI/ML and GenAI capabilities.
• Own the GenAI/LLM solutions architecture.
• Core specialisation in AI agents and autonomous workflows, data extraction and intelligent automation.
• Direct hands-on architectural oversight of large language models, applied AI and multi-layered deep learning products.
• Extensive expertise in building intelligent document automation systems — similar in complexity to patent parsing, legal workflow automation and structured decision intelligence tools.

Technical leadership

• A proven track record overseeing product architecture, tech strategy and cross-functional engineering execution across core full-stack and AI platforms.
• Collaborate with executive leadership on business strategy, client requirements and product delivery.
• Build, mentor and scale high-performing engineering teams with a growth mindset.
• Establish a strong technology culture grounded in ownership, innovation and continuous learning.

What success looks like

• Mission AI: build a world-class AI system leveraging GenAI, ML and enterprise-grade data engineering.
• Hyper-scaling: architect and scale the platform to match global industry leaders in the IP space.
• Culture building: develop a strong engineering organisation with high ownership, performance and innovation DNA.

Qualifications & experience

• Preferably under 15 years of enterprise software engineering experience across B2B SaaS or technology-first companies; fewer is fine for an exceptional engineer.
• A proven track record of taking early-stage AI/ML prototypes and scaling them into robust enterprise SaaS platforms featuring multi-agent orchestration, complex workflows and decision intelligence.
• Experienced in building and mentoring agile, lean startup teams of full-stack and machine learning engineers from the ground up.
• Proven leadership in defining and executing technology strategy and platform roadmaps.
• Extensive cloud-native engineering experience with Azure, AWS and GCP.

Technical expertise

• Strong full-stack engineering background (Java, Python, JavaScript frameworks).
• Expertise with JS frameworks such as React, Angular and Node.js.
• Experience building and scaling distributed systems and microservices.
• Strong knowledge of databases (SQL, NoSQL), data modelling and unstructured data management.
• Strong understanding of Agile methodologies and tools (Atlassian, Git, CI/CD pipelines).

Behavioural & leadership competencies

• Product and delivery management expertise, end to end, including delivery and customer support.
• Excellent communication, with the ability to influence executive stakeholders.
• High technical proficiency combined with strong business acumen.
• Strong analytical and decision-making skills.

Data Platform Engineer

Design, automate, and scale our data platform — this is an engineering role, not a traditional "DBA job.

Must-have :

• Data modeling & schema design (from first principles, not just maintenance)
• PostgreSQL (deep, hands-on — partitioning, replication, tuning)
• Any distributed NoSQL store (Cassandra, ScyllaDB, or similar wide-column/distributed DB) (real production experience)
• Python (automation & tooling, not just scripting)
• DevOps & CI/CD (building pipelines, not just using them)
• Terraform (infrastructure-as-code)

You'll:

• Design schemas, partitioning strategies, and lead the Postgres → Cassandra migration end-to-end
• Own PostgreSQL performance, replication, and zero-downtime schema changes
• Build Python-based automation to eliminate repetitive DB work
• Own CI/CD pipelines and Terraform-based infra provisioning
• Drive uptime, DR, monitoring, and incident response
• Own multi-tenant security (RLS, least-privilege access) and data governance

Experience: 4–9 years, data/database/platform engineering in demanding production environments.

Bonus: Kafka/Debezium (CDC), Redis, Flyway/Liquibase, GDPR/DPDP exposure.

Job Title : Senior Data Engineer – Databricks

Experience : 14 to 20 Years

Location : HSR Layout, Bangalore

Work Mode : Hybrid – 3 Days WFO

Shift : 11:30 AM – 07:30 PM IST

Positions : 2

Notice Period : Immediate Joiners Only

Interview : 1 Technical Round + 2 Client Rounds

Role Overview :

We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.

The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.

Must-Have Skills :

• 14 to 20 years of Data Engineering experience
• Databricks & Apache Spark / PySpark
• Python & SQL
• AWS Cloud
• Lakehouse Architecture
• ETL / ELT & Distributed Data Processing
• Batch & Streaming Pipelines
• Data Pipeline Optimization & Data Modeling
• CDC & Incremental Processing
• Git, CI/CD & Testing
• Data Quality, Monitoring & Observability
• Technical Leadership & Stakeholder Management

Key Responsibilities :

• Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
• Own data products from design through production.
• Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
• Optimize pipelines for performance, scalability, reliability, and cost.
• Design scalable data architectures and data models.
• Implement data quality, monitoring, lineage, and CI/CD practices.
• Lead technical discussions and mentor engineering teams.
• Collaborate with business stakeholders, architects, product owners, and engineering teams.
• Remain hands-on while providing technical leadership.

Ideal Candidate :

A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.

🔴 Super Urgent : Only Bangalore-based immediate joiners.

Job description: Data Architect – Databricks / AWS

Job Summary

We are looking for an experienced Data Architect to define and drive the target data architecture for the Horizon MVP and its future evolution. The role will be responsible for designing a scalable, secure, governed cloud data platform covering ingestion, storage, processing, analytics, APIs, and downstream data consumption.

The architect will work closely with Data Engineering, Backend, DevOps, QA, and business stakeholders to establish architecture standards and ensure the platform is ready for advanced analytics, AI/ML, vector storage, and future LLM-based capabilities.

• Job Title: Data Architect
• Experience: 8+ Years
• Relevant Architecture Experience: 3+ Years in Data Architecture
• Location: Chennai / Pune
• Work Mode: Hybrid – 3 Days WFO
• Budget: Up to 24 LPA
• Payroll: Haparz
• Notice Period: Immediate Preferred

Key Responsibilities

• Define the target data architecture for the Horizon MVP and establish an architecture roadmap for future scalability.
• Design end-to-end architecture covering data ingestion, storage, processing, serving, reporting, APIs, and downstream applications.
• Establish canonical data models and schemas for travel signals, corridors, sources, evidence, scores, and generated insights.
• Define data normalization strategies for structured, semi-structured, and unstructured data from multiple external sources.
• Design and govern the Databricks platform architecture, including Unity Catalog, data schemas, access controls, and governance standards.
• Establish data-retention, lineage, data-quality, security, privacy, and compliance controls.
• Define secure integration patterns between Databricks, AWS PRODIGY, SharePoint, external APIs, and downstream applications.
• Design scalable data processing for 30-day signal windows, convergence/divergence scoring, corridor ranking, and spike detection.
• Define architecture patterns that support future vector storage, embeddings, LLM integration, and multi-year analytics.
• Design reliable batch and API-driven ingestion frameworks for structured and unstructured data.
• Review technical designs, identify architectural risks, and provide technical direction to engineering teams.
• Guide backend, data engineering, DevOps, and QA teams in implementing architecture standards.
• Ensure architecture decisions align with enterprise security, RBAC, PII handling, privacy, and operational requirements.
• Communicate architecture decisions, trade-offs, and technical recommendations effectively to technical and business stakeholders.
• 
  

What We’re Looking For

• 8+ years of experience in data engineering, data platforms, or data architecture, with at least 3+ years in a Data Architect capacity.
• Strong hands-on experience designing cloud-based data platforms, lakehouses, or analytical platforms.
• Advanced knowledge of Databricks, Apache Spark/PySpark, Delta Lake, and Unity Catalog.
• Strong understanding of AWS data services, IAM, networking, and secure cloud integration patterns.
• Strong expertise in data modelling, metadata management, data lineage, data quality, retention, and governance.
• Experience architecting batch and API-based ingestion pipelines for structured, semi-structured, and unstructured data.
• Understanding of AI/ML workloads, feature pipelines, vector databases, embeddings, and LLM integration patterns.
• Experience designing APIs and downstream data-serving architectures.
• Strong knowledge of PII protection, RBAC, data privacy, and enterprise security controls.
• Excellent architectural communication and stakeholder-management skills.

Job Description

• Design and Implement Data Solutions: Lead the design, development, and implementation of scalable and secure Azure-

based data platforms, ensuring integration with various data sources and business systems. Deliver at least 2 major

projects every year with a focus on data engineering best practices.

• Optimize Data Pipelines: Build and optimize end-to-end data pipelines using Azure Data Factory, Azure Databricks, and

Azure Synapse, with an emphasis on automating data workflows. Achieve a 20% reduction in pipeline execution times

within the first 6 months.

• Cloud Infrastructure Management: Manage and maintain the Azure data environment, ensuring high availability, disaster

recovery, and cost optimization. Track and improve system uptime to exceed 99.9% reliability.

• Collaborate with Cross-Functional Teams: Partner with data scientists, data analysts, and business stakeholders to translate

business requirements into efficient data solutions. Facilitate at least 3 collaborative sessions per quarter to address key

business use cases.

• Ensure Data Security & Compliance: Implement data security measures, ensuring compliance with industry regulations

(GDPR, HIPAA, etc.) and company policies. Achieve and maintain full compliance in all data environments within the first

quarter of onboarding.

• Continuous Learning & Knowledge Sharing: Stay up-to-date with emerging Azure technologies, and mentor junior

engineers to promote knowledge sharing. Complete 1 Azure certification annually and conduct at least 2 internal

knowledge-sharing sessions per year.

• Sound knowledge of data governance practices, data quality management, and data security principles.

• Play a pivotal role in shaping our organization's data-driven journey, driving innovation through data analytics and insights.

• Optimize data storage, processing and retrieval mechanisms for performance, cost, and scalability using data storage

services (such as Azure Data Lake Storage, Azure SQL Database, etc.), data processing services (such as Azure Data Bricks,

Azure Synapse, etc.) and data visualization (PowerBI, Qlik, etc.) & integration services (Data API builder, logic apps, etc.)

• Monitor and troubleshoot data platform performance, identify and resolve issues, and provide recommendations for

continuous improvement.

• Collaborate with DevOps teams to automate deployment, configuration, and monitoring processes using Azure DevOps,

PowerShell, or other relevant tools.

• Stay up to date with the latest trends and advancements in cloud data services and provide recommendations on adopting

new technologies or features to enhance the data platform.

• Document technical designs, procedures, and guidelines for data platform engineering and operations

Knowledge, Skills & Experience

Job Experience • Bachelor's degree in Computer Science, Engineering, or a related field. Advanced

degree preferred.

• Proven 6-10 years experience in playing platform engineer or admin role

• Experience with big data technologies such as Apache Spark, Hadoop, or similar

frameworks.

• Solid understanding of cloud computing concepts and experience with cloud

infrastructure management and provisioning.

• Solid understanding of network security concepts and technologies (such as

firewalls, VPNs, intrusion detection/prevention systems, etc.) and data security

concepts and technologies (such as access controls, encryption, observability,

privacy laws/regulations, etc.)

• Experience in a Retail setup is preferred.

Required Skills The position will require someone with the following:

• Strategic Planning

Public

• Communication and Collaboration

• Problem Solving Skills A/B testing & experimentation

• SQL, BI tools, and storytelling with data

Role Overview

We are looking for a GCP Data Engineer with 10+ years of experience to design, develop, and optimize scalable cloud-based data solutions. The ideal candidate will have strong hands-on expertise in GCP, BigQuery, and advanced SQL, with experience building data pipelines and working with large-scale datasets.

Key Responsibilities

• Design and develop scalable data pipelines and ETL/ELT processes on GCP.
• Build, optimize, and maintain data solutions using Google BigQuery.
• Develop complex SQL queries for data transformation, aggregation, and analysis.
• Design efficient data models and optimize pipelines for performance, scalability, and cost.
• Integrate data from multiple sources and ensure data quality, reliability, and availability.
• Troubleshoot pipeline and data issues and drive continuous improvement.
• Collaborate with data architects, analysts, application teams, and business stakeholders.
• Follow best practices for cloud security, data governance, testing, and documentation.

Required Skills

• 8+ years of Data Engineering experience
• Strong hands-on experience with GCP, Django, and MongoDB
• Extensive experience with BigQuery
• Advanced SQL skills
• Strong understanding of ETL/ELT and data pipeline development
• Data modeling and data warehousing experience
• Experience handling large-scale datasets and performance optimization
• Strong problem-solving and communication skills

Good to Have

• GCP services such as Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, or Cloud Functions
• Python or other data engineering languages
• Experience with data governance and security
• Agile development experience

Roles & Responsibilities

• Design, develop, and deliver scalable end-to-end data pipelines using Azure Data Factory, ensuring robust integration

of enterprise-wide data from diverse sources

• Build and optimize data engineering workflows using Databricks and PySpark

• Write efficient, high-performance SQL for data transformation and analysis

• Work with the Azure Cloud platform and associated services, applying strong understanding of data warehousing,

data models, and pipelines

• Provide technical leadership to a team of developers, including code reviews and enforcing best practices across the

development lifecycle

• Oversee CI/CD implementation using Azure DevOps, managing deployments across development, QA, and production

environments with proper change control processes

• Collaborate with cross-functional teams to translate business requirements into scalable data solutions

• Ensure data quality, reliability, and performance across all pipelines and platforms

Ideal Candidate

1Strong Azure Databricks Engineer / Senior Data Engineer Profile

2Mandatory (Experience 1) – Must have minimum 8+ years of overall experience in Data Engineering, Data Development, or related data technology roles, with strong hands-on experience in enterprise data pipeline development.

3Mandatory (Experience 2) – Must have strong hands-on experience with Azure Databricks, including development and optimization of scalable data engineering workflows using Databricks and PySpark.

4Mandatory (Experience 3) – Must have strong hands-on proficiency in PySpark/Python and SQL, with proven experience developing complex data transformations, processing workflows, and performance-optimized queries.

5Mandatory (Experience 4) – Must have hands-on experience with Azure Data Factory (ADF) for designing, developing, and orchestrating end-to-end data pipelines and integrating data from multiple sources.

6Mandatory (Experience 5) – Must have strong experience working on the Azure Cloud platform and associated data services, with solid understanding of data warehousing, data modeling, pipeline architecture, and enterprise data solutions.

7Mandatory (Experience 6) – Must have hands-on experience implementing CI/CD using Azure DevOps, including deployment and release management across development, QA, and production environments.

8Mandatory (Experience 7) – Must have proven technical leadership experience, including code reviews, enforcing development best practices, mentoring developers, and providing technical guidance to a data engineering team.

9Mandatory (Notice Period) – Immediate joiners or candidates who can join within 15 days.

10Mandatory (Note) - The position is open across all Cognizant offices pan India. Candidates must be willing to attend the F2F interview at the nearest Cognizant office location.

Description

We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
• Build and optimize distributed data applications using Apache Spark and Python Scala.
• Develop reliable, high-performance data pipelines for batch and streaming workloads.
• Design and manage data workflows using Apache Airflow.
• Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
• Work with large datasets to ensure data quality, consistency, reliability, and performance.
• Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
• Optimize data workflows for scalability, reliability, performance, and cost efficiency.
• Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.

Requirements

Candidates who demonstrate:

• 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
• Strong hands-on experience with Apache Spark and Scala.
• Experience designing, building, and maintaining large-scale ETL pipelines.
• Strong hands-on experience with AWS, particularly Amazon S3.
• Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
• Strong SQL skills and a solid understanding of distributed data processing concepts.
• Experience working with batch and/or streaming data pipelines.
• Excellent debugging, problem-solving, and performance optimization skills.
• Strong communication and collaboration skills.

Good to Have

• Experience with Databricks and the broader Databricks data platform.
• Familiarity with streaming technologies such as Apache Kafka.
• Experience working on large-scale data platforms handling high-volume data workloads.
• Exposure to additional AWS data services and cloud-native data architectures.

Description

We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising insights and analytics. The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Spark and Scala.

You will work on designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
• Build and optimize distributed data applications using Spark and Scala.
• Develop reliable, high-performance data pipelines for batch and streaming workloads.
• Work with large datasets to ensure data quality, consistency, and performance.
• Collaborate with engineering, product, and analytics teams to deliver robust data solutions.
• Optimize data workflows for scalability, reliability, and cost efficiency.
• Deploy and manage data workloads in cloud and containerized environments.
• Troubleshoot production issues and continuously improve platform performance.

Requirements

Candidates who demonstrate:

• 5+ years of experience in Data Engineering or Big Data Engineering.
• Strong hands-on experience with Apache Spark and Scala.
• Experience building and maintaining ETL pipelines.
• Familiarity with Google Cloud Storage (GCS).
• Experience with Kubernetes (K8s).
• Strong SQL skills and understanding of distributed data processing.
• Excellent debugging, problem-solving, and performance optimization skills.
• Strong communication and collaboration skills.

Good to Have

• Experience with AWS and cloud-native data services.
• Familiarity with streaming technologies such as Kafka.
• Experience working on large-scale data platforms or AdTech systems.
• Exposure to orchestration tools such as Airflow.

Benefits

• Best-in-class salary: We hire strong talent and compensate accordingly.
• Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
• Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
• High-impact work: Build AI-first systems and products used at scale by global clients.

About Us

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.

Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.