Principal Data Engineer

Join our product development team at Planview as a Senior Software Engineer I and become a pivotal force on the Viz Core Team. This role offers the unique opportunity to shape and lead the development of data-processing pipelines and APIs that are at the heart of our software solutions. These solutions are designed to streamline and enhance the efficiency of software delivery, resonating deeply with software engineers who strive to build better and faster.

At Planview Viz, which is powered by the innovative “Flow Framework,” you will tackle complex data challenges and develop scalable solutions within an AWS cloud environment. Your efforts will be crucial in revolutionizing how businesses harness and interpret vast amounts of workflow data, transforming it into actionable insights that propel organizational efficiency and effectiveness.

Responsibilities (What you'll do)

• Create and refine powerful data-processing architectures that integrate seamlessly with a diverse array of external tools, enhancing the way software is delivered across industries.
• Drive operational excellence by critically analyzing problems, defining requirements, and devising robust solutions that push the boundaries of technology.
• Lead and inspire a team of talented engineers, promoting a culture of ownership, meticulous attention to quality, and proactive problem-solving.
• Stay at the cutting edge of technology by updating and expanding your team’s knowledge of cloud architectures, data processing, and advanced analytics, ensuring that you and your team remain leaders in technological innovation.
• Make a direct impact on the efficiency and effectiveness of software delivery worldwide through innovation and leadership.

Qualifications (What you'll bring)

Who We’re Looking For

The ideal candidate is a seasoned professional in cloud software development with a strong foundation in data processing and scalable software systems. You thrive in collaborative environments and are passionate about advancing cloud technology and data architecture to new heights. You are a leader who enjoys mentoring, guiding, and inspiring others.

Preferred Qualifications

Skills, Knowledge, and Expertise

• A degree in Computer Science, Engineering, or a related field.
• 6+ years of experience with a modern programming language, with a focus on back-end systems and cloud-based technologies.
• Strong capability in architecting and designing robust, scalable software systems.
• Proficiency in AWS or another popular cloud platform.

Additional Qualifications

• Experience with big-data technologies such as Spark and Apache Kafka.
• Experience with Java (version 17), Scala, or other JVM programming languages.
• Experience with tools such as Amazon Redshift and MongoDB.
• Experience with continuous integration and continuous deployment tools such as GitHub, Jenkins, Travis CI, or similar platforms.
• Proficiency in test-driven development.
• Experience with containers and orchestration tools such as Kubernetes.
• Experience working on remote or distributed teams and projects.

Job Title : Tech Lead – Data Lake Platform

Number of Positions : 2

Experience : 7+ Years

Role Type : Technical Lead / Data Platform Lead

Domain : Data Engineering / Data Platform / AWS

About the Role :

We are looking for an experienced Tech Lead – Data Lake Platform to lead the design, development, and operations of an enterprise-scale AWS-based Data Lake Platform.

The platform will ingest data from multiple business systems, process it through structured data layers, and serve data for analytics, reporting, APIs, and operational applications.

As a Tech Lead, you will be responsible for setting the technical direction, leading data engineering teams, driving platform reliability and performance, and owning the platform's delivery, governance, and production support end to end.

Core Tech Stack :

AWS | S3 | EMR | Glue | Athena | Redshift | DMS | Lambda | RDS | IAM | Airflow | Spark/PySpark | SQL | Data Modeling | Hasura | GraphQL | DBT | PostgreSQL/Aurora | Kafka

Key Responsibilities :

• Own the overall Data Lake Platform architecture, covering data ingestion, staging, curated layers, consumption, analytics, and API/data serving.
• Lead the design and development of production-grade data pipelines using AWS Glue, EMR/Spark, Airflow, DBT, Athena, and Redshift.
• Design scalable batch and analytics pipelines with a focus on reliability, performance, data quality, and maintainability.
• Own the API/data-serving architecture from consumption data → RDS/PostgreSQL → Hasura GraphQL → Lambda/API Gateway.
• Drive improvements in platform stability, including orchestration failures, cluster sizing, pipeline SLAs, query performance, and production reliability.
• Design and implement appropriate AWS security, access control, IAM, PII handling, and data governance practices.
• Lead technical discussions, architecture decisions, code reviews, and engineering best practices.
• Mentor and guide data engineers while ensuring high-quality and scalable engineering delivery.
• Own production support, incident management, troubleshooting, and root-cause analysis (RCA) for critical data platform issues.
• Develop and maintain runbooks, operational procedures, monitoring, and incident response practices.
• Collaborate with business, product, application, and analytics teams to onboard new datasets and support reporting, API, and data consumption requirements.
• Ensure the platform meets defined availability, performance, security, data quality, and compliance requirements.

Must-Have Skills :

• 7+ years of experience in Data Engineering, Data Platform Engineering, or related areas, including experience in technical leadership or architecture.
• Strong hands-on experience with AWS Data Services, including:
• Amazon S3
• AWS EMR
• AWS Glue
• Amazon Athena
• Amazon Redshift
• AWS DMS
• AWS Lambda
• Amazon RDS
• AWS IAM
• Strong production experience with Apache Airflow.
• Strong hands-on experience with Apache Spark / PySpark.
• Strong SQL skills and experience with data modeling, including layered data architecture, data marts, and enterprise data models.
• Experience with Hasura or a similar GraphQL layer for PostgreSQL-based data/API serving.
• Strong understanding of data lake architecture and enterprise data platforms.
• Proven experience leading engineers and driving technical decisions.
• Hands-on experience with production support, troubleshooting, incident management, and RCA.
• Strong understanding of data platform performance, scalability, reliability, and SLA management.

Good-to-Have Skills :

• Experience with DBT and modern data transformation practices.
• Experience with lakehouse table formats on Amazon S3, such as Apache Iceberg or similar technologies.
• Strong knowledge of Amazon Redshift workload optimization, including :
• Distribution keys
• Sort keys
• Spectrum
• External tables
• Experience with Kafka or other streaming/data ingestion technologies.
• Experience with PostgreSQL / Amazon Aurora as a data-serving layer.
• Experience with Lambda and API Gateway for API-based data serving.
• Experience with enterprise data governance, data quality, security, and compliance.
• Experience in BFSI / Banking / Financial Services / Insurance domain.

Ideal Candidate :

The ideal candidate is a hands-on Data Platform / Data Engineering Lead who can operate at both the architecture and implementation level. You should be comfortable designing an AWS Data Lake from end to end, leading engineers, troubleshooting production issues, and working closely with business and application teams to deliver reliable data products.

Overview

Planview has one mission: to build the future of connected work, from ideas to impact.

As the global leader in work and resource management, Planview helps organizations accelerate the achievement of what matters most, supporting our customers from need to speed, from passion to progress, and from overhead to optimization. We provide the industry’s most comprehensive solutions designed for strategic planning, portfolio and resource management, Lean and Agile delivery, product portfolio management, capability, technology management (enterprise architecture), innovation management, collaborative work and project management. Our connected platform of solutions underpins the business and digital transformations of more than 4,500 customers globally, including 59 of the Fortune 100.

At Planview, our people connections drive our innovation and success. Our global team of 1400+ work remotely and across our offices including Austin, Vancouver, Hod HaSharon, Bangalore, and Stockholm. We are proud of our world-class, connected culture built on our shared values, that supports our teams to be successful from anywhere.

The Opportunity

Join our product development team at Planview as a Software Engineer 2 and contribute to the Viz Core Team. This role provides an exciting opportunity to support the development of data processing pipelines and APIs that form the backbone of our software solutions. You will work collaboratively to enhance the efficiency of software delivery, developing solutions that help organizations harness and interpret workflow data.

In this role, you will

•Collaborate with senior engineers to create and refine data processing architectures that integrate with various external tools.

•Assist in analyzing problems, defining requirements, and proposing solutions that align with the team’s objectives.

•Contribute to a culture of quality and continuous improvement by providing thoughtful feedback on code and design.

•Learn and apply best practices in cloud architectures and data processing to deliver high-quality software solutions.

•Engage in an environment that values innovation and teamwork, where your contributions will positively impact the delivery of software solutions.

Who we are looking for

The ideal candidate is an emerging professional in cloud software development with a solid foundation in data processing and software systems. You thrive in collaborative environments and are eager to learn and grow within the field.

Preferred qualifications skills, knowledge, and expertise

•Degree in Computer Science, Engineering, or a related field.

•3+ years of experience with any modern programming language, focusing on back-end systems and cloud-based technologies.

•Basic understanding of data structures, algorithms, and software development methodologies.

•Familiarity with cloud platforms, particularly AWS or similar services.

Other beneficial qualifications

•Exposure to big data technologies like Spark or Apache Kafka.

•Experience with Java (v17), Scala, or other JVM programming languages.

•Familiarity with storage tools such as PostgreSQL and MongoDB.

• Understanding of continuous integration/deployment tooling such as GitHub or Jenkins.

• Awareness of Test-Driven Development practices.

• Basic knowledge of containers and orchestration tools like

Location: Bangalore

Department: Engineering

Reports to: SVP

Experience required: 6+ years

About Tracxn:

Tracxn (Tracxn.com) is a Bangalore-based product company providing a research and deal sourcing platform for Venture Capital, Private Equity, Corp Dev, and professionals working around the startup ecosystem.

We are a team of 600+ working professionals serving customers across the globe. Our clients include Funds like Andreessen Horowitz, Matrix Partners, GGV Capital, and Large Corporations such as Citi, Embraer & Ferrero.

Founders

• Neha Singh (ex-Sequoia, BCG | MBA - Stanford GSB)
• Abhishek Goyal (ex-Accel Partners, Amazon | BTech - IIT Kanpur)

About Technology Team: 

Tracxn's Technology team is 60+ members strong and growing. The technology team is subdivided into multiple smaller teams, each owning one or more services/components of the technology platform. Ours is a young team of motivated engineers with a minimal management structure where almost everyone is actively involved in technical development and design activities. We have a team-centric culture where the ownership and responsibility of a feature or module lie with a team compared to an individual.

We value ownership, continuous learning, consistency, and discipline as a team.

Our Tech Stacks:

We work on an array of technologies, including but not limited to backend and frontend systems such as Java, Python, Spring Boot, Node.js, ReactJS, Next.js, Webpack, and Storybook; cloud and serverless platforms like AWS, etc; data and infrastructure technologies such as Elastic Stack (Elasticsearch), MongoDB, MySQL, Redis, Kafka, and Ansible; large-scale web crawling solutions; modern data pipelines and ETL workflows; and AI/ML-driven projects.

Job Overview:

We are looking for experienced software engineers with 6+ years of overall software development experience, including backend development and proven people-management skills. The ideal candidate will lead the engineering team(s), drive technical excellence, and ensure timely delivery of high-quality software solutions.

Job Responsibilities:

• Lead, mentor, and manage a team of software engineers
• Own technical planning, architecture discussions, and execution
• Collaborate with product managers and stakeholders
• Drive best practices in software development, testing, and deployment
• Conduct code reviews and ensure high engineering standards
• Manage delivery timelines, resource planning, and technical risks
• Support hiring, onboarding, and performance management of engineers

Job Requirements :

Professional Experience

•  Proven experience leading or managing software engineering teams
• Track record of delivering complex, scalable software systems
• Experience driving technical initiatives and influencing architectural decisions
• Strong collaboration experience with product, design, and cross-functional teams.

Technical Leadership & Management

•  Ability to mentor, coach, and grow engineers across different experience levels
• Experience conducting performance reviews and providing technical feedback
• Strong ownership of team delivery, timelines, and quality
• Experience balancing hands-on technical work with people management

Backend & System Architecture Expertise

• Strong proficiency in modern backend architectures, design patterns, and microservices architecture.
• Proficiency in at least one server-side programming language (e.g., Java, Python, etc.)
• Solid understanding of API design principles and implementation
• Hands-on experience with relational and non-relational databases and knowledge of data pipelines and data warehousing concepts.

Technical Competencies

• Strong system design and problem-solving skills
• Knowledge of caching strategies, performance optimization, and scalability
• Understanding of data modeling and query optimization
• Familiarity with search and indexing technologies
• Understanding of security best practices in backend systems

Culture:

• Work with performance-oriented teams driven by ownership and passion.
• Learn to design systems for high accuracy, efficiency, and scalability.
• No strict deadlines, focus on delivering quality work.
• Meritocracy-driven, candid culture. No politics.
• Very high visibility regarding which startups and markets are exciting globally.

We are hiring for a Data Engineer & Java scala for a full-time opportunity in Bangalore.

Experience: 4–10 Years

Must-Have Skills:

Java / Scala / Python, Data Engineering, Databricks / Snowflake, and Cloud (AWS / Azure / GCP).

We are looking for strong software engineers with hands-on experience in data platform development, scalable backend programming, data integration, and cloud technologies.

Experience in Banking, Capital Markets, Market Risk, or Regulatory Reporting will be an added advantage.

Description

We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
• Build and optimize distributed data applications using Apache Spark and Python Scala.
• Develop reliable, high-performance data pipelines for batch and streaming workloads.
• Design and manage data workflows using Apache Airflow.
• Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
• Work with large datasets to ensure data quality, consistency, reliability, and performance.
• Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
• Optimize data workflows for scalability, reliability, performance, and cost efficiency.
• Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.

Requirements

Candidates who demonstrate:

• 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
• Strong hands-on experience with Apache Spark and Scala.
• Experience designing, building, and maintaining large-scale ETL pipelines.
• Strong hands-on experience with AWS, particularly Amazon S3.
• Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
• Strong SQL skills and a solid understanding of distributed data processing concepts.
• Experience working with batch and/or streaming data pipelines.
• Excellent debugging, problem-solving, and performance optimization skills.
• Strong communication and collaboration skills.

Good to Have

• Experience with Databricks and the broader Databricks data platform.
• Familiarity with streaming technologies such as Apache Kafka.
• Experience working on large-scale data platforms handling high-volume data workloads.
• Exposure to additional AWS data services and cloud-native data architectures.

Hiring for Data Engineer - Delivery Manager

Exp : 10 - 15 yrs

Edu : BE/B.Tech/MCA

Work Loation : Hyderabad

.Roles & Responsibilitie:

Own end-to-end delivery of data engineering programs ensuring alignment with business goals, timelines, and quality standards.

Drive execution across multiple data initiatives within Azure and Databricks environments.

Provide technical leadership in designing and implementing scalable data pipelines using Python, PySpark, and Spark.

Required Skills:

Strong experience with Databricks, PySpark, Python, and Spark.

Expertise in Azure Data Services including ADF, ADLS, and Synapse.

Proven experience in delivery management, stakeholder management, and Agile execution

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Description

We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising insights and analytics. The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Spark and Scala.

You will work on designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
• Build and optimize distributed data applications using Spark and Scala.
• Develop reliable, high-performance data pipelines for batch and streaming workloads.
• Work with large datasets to ensure data quality, consistency, and performance.
• Collaborate with engineering, product, and analytics teams to deliver robust data solutions.
• Optimize data workflows for scalability, reliability, and cost efficiency.
• Deploy and manage data workloads in cloud and containerized environments.
• Troubleshoot production issues and continuously improve platform performance.

Requirements

Candidates who demonstrate:

• 5+ years of experience in Data Engineering or Big Data Engineering.
• Strong hands-on experience with Apache Spark and Scala.
• Experience building and maintaining ETL pipelines.
• Familiarity with Google Cloud Storage (GCS).
• Experience with Kubernetes (K8s).
• Strong SQL skills and understanding of distributed data processing.
• Excellent debugging, problem-solving, and performance optimization skills.
• Strong communication and collaboration skills.

Good to Have

• Experience with AWS and cloud-native data services.
• Familiarity with streaming technologies such as Kafka.
• Experience working on large-scale data platforms or AdTech systems.
• Exposure to orchestration tools such as Airflow.

Benefits

• Best-in-class salary: We hire strong talent and compensate accordingly.
• Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
• Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
• High-impact work: Build AI-first systems and products used at scale by global clients.

About Us

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.

Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.

Company Name – Wissen Technology

Group of companies in India – Wissen Technology & Wissen Infotech

Work Location – Whitefield, Bangalore

Website and Company profile:

www.wissen.com

LinkedIn Page:

https://www.linkedin.com/company/wissen-technology/

While you may already know about Wissen and the company history, here is a quick rundown for you.

About Wissen Technology:

·    The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015.

·    Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products.

·    Our workforce has highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like Wharton, MIT, IITs, IIMs, and NITs and with rich work experience in some of the biggest companies in the world.

·    Wissen Technology has grown its revenues by 400% in these five years without any external funding or investments.

·    Globally present with offices US, India, UK, Australia, Mexico, and Canada.

·    We offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.

·    Wissen Technology has been certified as a Great Place to Work®.

·    Wissen Technology has been voted as the Top 20 AI/ML vendor by CIO Insider in 2020.

·    Over the years, Wissen Group has successfully delivered $650 million worth of projects for more than 20 of the Fortune 500 companies.

·    We have served client across sectors like Banking, Telecom, Healthcare, Manufacturing, and Energy. They include likes of Morgan Stanley, Goldman Sachs, MSCI, StateStreet, Flipkart, Swiggy, Trafigura, GE to name a few.

About Role :

Key Responsibilities

• Build and maintain data transformation pipelines using java Spark
• Develop and optimize large-scale/CPU intensive data processing using Apache Spark
• Orchestrate workflows using Airflow
• Implement data quality checks, testing, and monitoring for pipeline. Good to have exposer into managing metadata, cataloguing, and lineage
• Support schema evolution, backfills, and incremental processing
• Ensure pipelines meet SLAs for freshness, reliability, and performance
• Expertise/working knowledge in Spark and HBase(semantic layer, virtual datasets, Reflections)

Required Skills & Qualifications

• Strong hands-on experience with 
• HBase
• Apache Spark
• Experience with HBase or similar lakehouse query engines
• Airflow 
• Understanding of data catalogs and lineage (e.g., OpenLineage, DataHub, Apache Polaris , openlineage)
• Proficiency in Java
• Experience with Git-based development and CI/CD

Nice-to-Have Skills

• OpenTable format/Iceberg ,Apache Arrow
• CDC-based analytics pipelines
• Cloud platforms (AWS)
• Kubernetes-based data platforms