Big Data Developer

Job Description

Position Title: Java Technical Lead

Position Type: Full Time, Permanent

Department: Research and Development

Reports to: R&D Manager, Indian Development Centre.

Company Background:

-CGLIA is a software development company building highly available, highly secure, cloud-based enterprise software products that helps speed the research process resulting in new drugs, new devices, and new treatments to improve the health and wellbeing of world population.

- At CGLIA, our work shows our dedication and passion for innovative quality software products that are intuitive and easy to use and exceeds every aspect of customer expectations.

- CGLIA, is the place that develops world-class professionals who would like to be innovative, creative, learn continuously, and build a solid foundation to build products that are special and delight the customer.

Job Summary:

As a Technical Manager, you will be providing the guidance to all the team members in designing, implementing and delivering the technical solutions.

Also, responsible to maintaining the existing product line with high quality and timely deliverables by working closely with product teams.

In this role, you will be hiring the new development staff, oversee each aspect of the development process, and act as a liaison between development team and upper management. Also ensures that team is fully trained and able to perform their jobs.

Should possess strong leadership skills and ability to resolve the challenges quickly.

Responsibilities:

• Participate and contribute to project planning and effort estimation.
• Demonstrate exceptional requirements gathering skills and support requirement gathering sessions.
• Contribute to technical design of business solutions.
• Support leadership team in development RFP’s and service offerings.
• Review and analyse relevant documentation to ensure the understanding of an organization function and capabilities.
• Conduct relevant research to increase understanding in support of developing comprehensive solutions.
• Comply with all the relevant policies and procedures and complete all the documents that are required.
• Conducting performance reviews, handling the employee complaints
• Willing to undertake additional tasks and responsibilities as may be reasonably expected of the role and as necessary in order to achieve the objectives of the organization.

Qualifications: (Education, Experience, Skills and Knowledge)

• Bachelor’s Degree in Computer Science or Information Technology or any equivalent degree.
• At least 8 plus years of hands on experience in developing cloud-based software along with 2 plus years of Management experience.
• Expertise with more than one of the Software Development Methodologies.
• Expertise in designing and developing cloud based high available distributed applications and must have extensive experience in object-oriented design.
• Strong hands on experience in using Java, Hibernate, Spring technology stack (Spring MVC, Spring Data, Spring Cloud, Spring Batch, Spring security etc.) along with open source technologies.
• Experience building web and mobile applications using frontend technologies Angular (Angular 1/Angular 2), Bootstrap, Material Design, UX/UI, JavaScript, HTML5, and CSS.
• Demonstrated Experience on databases like MySQL, MS SQL, PostgreSQL, and Oracle.
• An understanding on handling of large data sources. (Desirable)
• Expertise on the Code Static Analyzer tools like SonarQube, PMD and, DevOps Tools.
• Expertise in using any Unit testing Frameworks like Junit.
• Knowledge in Security related to Web Applications and mobile applications. and other open source and commercial tools.
• Demonstrable and substantial experience in leading and managing teams of software developers.
• Impeccable written English skills, and Oral communication skills along with outstanding interpersonal skills.
• Results-oriented, detail-oriented, and well organized.

Technical Manager: Requires sufficient Managerial Skills and sufficient technical skills.

Main function has to be focused on people. He or She can and should learn new things in technology, that is required for the role.

Position Title: Software Engineer

Position Type: Full Time

Department: Research and Development

Reports to: First Level Manager, Indian Development Centre.

Company Background:

Affiliated with US Group companies, CGLIA Solutions LLP is an innovative Software Product Development Organization developing high available, highly secure, cloud-based enterprise software products catering to the needs of Large Research facilities, University medical centres, Hospitals, Pharma companies in US and worldwide ultimately leading to the development of life saving medications.

CGLIA is known for helping Software professionals to unleash their creativity, turning them into world class professionals, and building their career.

Job Summary:

As a Software Engineer, you assist in the design development of new products for our renowned customers worldwide.

Enhancing the existing applications by identifying the areas of improvements, making recommendations and designing and implementing them. 

Ideal candidate should be a self-starter and, should have excellent problem-solving skills and passionate about developing high quality innovative products exceeding the customer expectations and needs. A keen interest for quality at every stage of development is a must.

Looking for a highly motivated individual who is looking to grow their career in a challenging environment.

Responsibilities:

• Participating in discussion with Product Management teams and Generating the Requirement Specification document that has covers both the functional and Non-functional requirements.
• Participating in discussion with the technical teams and generating the design documents.
• Develop code and update the existing code, ensuring that all the code meets the agreed upon requirements.
• Perform intensive testing of all new and existing programs to ensure they are free of errors and function as intended
• Work closely with the cross functional teams like UI Developers, Business Analysts and Management teams.
• Cultivate an environment of collaboration, commitment, accountability, and creativity and deliver products and services on time with quality delight the customer.
• Actively participating in the hiring process, for Organization growth.
• Updates job knowledge by studying latest development tools, programming techniques, and participating in professional organizations.
• Willing to undertake additional tasks and responsibilities as may be reasonably expected of the role and as necessary in order to achieve the objectives of the organization.

Qualifications: (Education, Experience, Skills and Knowledge)

·        Bachelor’s Degree in Computer Science or Information Technology or any equivalent degree.

·        At least 4 plus years of hands on experience in developing cloud-based software.

·        Expertise in developing cloud based distributed applications and must have experience in object-oriented design.

·        Strong hands on experience in using Java, Hibernate, Spring technology stack (Spring MVC, Spring Data, Spring Cloud, Spring Batch, Spring security etc.) along with open source technologies.

• Experience building web and mobile applications using frontend technologies Angular (Angular 1/Angular 2), Bootstrap, Material Design, UX/UI, JavaScript, HTML5, and CSS.

·        Experience on any one of databases like MySQL, MS SQL, PostgreSQL, and Oracle.

·        Exposure with more than one of the Software Development Methodologies.

·        Knowledge on the Code Static Analyzer tools like SonarQube, PMD etc. and, DevOps Tools.

·        Expertise in Security related to Web Applications and mobile applications. and other open source and commercial tools.

·        Ability to work independently and along with teams.

·        Impeccable written English skills, and Oral communication skills along with outstanding interpersonal skills.

·        Eagerness and willingness to learn new technologies.

Location: Bangalore

Department: Engineering

Reports to: SVP

Experience required: 6+ years

About Tracxn:

Tracxn (Tracxn.com) is a Bangalore-based product company providing a research and deal sourcing platform for Venture Capital, Private Equity, Corp Dev, and professionals working around the startup ecosystem.

We are a team of 600+ working professionals serving customers across the globe. Our clients include Funds like Andreessen Horowitz, Matrix Partners, GGV Capital, and Large Corporations such as Citi, Embraer & Ferrero.

Founders

• Neha Singh (ex-Sequoia, BCG | MBA - Stanford GSB)
• Abhishek Goyal (ex-Accel Partners, Amazon | BTech - IIT Kanpur)

About Technology Team: 

Tracxn's Technology team is 60+ members strong and growing. The technology team is subdivided into multiple smaller teams, each owning one or more services/components of the technology platform. Ours is a young team of motivated engineers with a minimal management structure where almost everyone is actively involved in technical development and design activities. We have a team-centric culture where the ownership and responsibility of a feature or module lie with a team compared to an individual.

We value ownership, continuous learning, consistency, and discipline as a team.

Our Tech Stacks:

We work on an array of technologies, including but not limited to backend and frontend systems such as Java, Python, Spring Boot, Node.js, ReactJS, Next.js, Webpack, and Storybook; cloud and serverless platforms like AWS, etc; data and infrastructure technologies such as Elastic Stack (Elasticsearch), MongoDB, MySQL, Redis, Kafka, and Ansible; large-scale web crawling solutions; modern data pipelines and ETL workflows; and AI/ML-driven projects.

Job Overview:

We are looking for experienced software engineers with 6+ years of overall software development experience, including backend development and proven people-management skills. The ideal candidate will lead the engineering team(s), drive technical excellence, and ensure timely delivery of high-quality software solutions.

Job Responsibilities:

• Lead, mentor, and manage a team of software engineers
• Own technical planning, architecture discussions, and execution
• Collaborate with product managers and stakeholders
• Drive best practices in software development, testing, and deployment
• Conduct code reviews and ensure high engineering standards
• Manage delivery timelines, resource planning, and technical risks
• Support hiring, onboarding, and performance management of engineers

Job Requirements :

Professional Experience

•  Proven experience leading or managing software engineering teams
• Track record of delivering complex, scalable software systems
• Experience driving technical initiatives and influencing architectural decisions
• Strong collaboration experience with product, design, and cross-functional teams.

Technical Leadership & Management

•  Ability to mentor, coach, and grow engineers across different experience levels
• Experience conducting performance reviews and providing technical feedback
• Strong ownership of team delivery, timelines, and quality
• Experience balancing hands-on technical work with people management

Backend & System Architecture Expertise

• Strong proficiency in modern backend architectures, design patterns, and microservices architecture.
• Proficiency in at least one server-side programming language (e.g., Java, Python, etc.)
• Solid understanding of API design principles and implementation
• Hands-on experience with relational and non-relational databases and knowledge of data pipelines and data warehousing concepts.

Technical Competencies

• Strong system design and problem-solving skills
• Knowledge of caching strategies, performance optimization, and scalability
• Understanding of data modeling and query optimization
• Familiarity with search and indexing technologies
• Understanding of security best practices in backend systems

Culture:

• Work with performance-oriented teams driven by ownership and passion.
• Learn to design systems for high accuracy, efficiency, and scalability.
• No strict deadlines, focus on delivering quality work.
• Meritocracy-driven, candid culture. No politics.
• Very high visibility regarding which startups and markets are exciting globally.

Company Description

TECHSOPHY specializes in productizing solutions based on new technology, focusing on emerging platforms of BPM & ECM, Low Code, AI (ML/RPA/NLP). Founded in 2009, TECHSOPHY operates with headquarters in California, USA, and regional offices in Dubai, UAE, and an offshore innovation center in Hyderabad, India.

Qualifications

• Solid Fundamentals and exceptional problem-solving skills
• Solid and fluent understanding of algorithms and data structures
• Proficiency in Scala + Spark
• Proficiency in Scala + Play framework
• Experience Range: 4 to 7 Years

Requirement:

Some or all of them – because we believe intelligent people can pick up whatever they need in a short period of time. You just need to prove that you can:

• Excellent programming skills and knowledge of Java / Scala
• Excellent software design, problem-solving, and debugging skills
• Experience with modern Big Data technologies such as Spark, NoSQL, Cassandra, Kafka, MapReduce, and the Hadoop ecosystem is a must-have
• Experience with data analytics and the ability to mine data to obtain insights are much appreciated

Position Title: Software Engineer

Position Type: Full Time

Department: Research and Development

Reports to: First Level Manager, Indian Development Centre.

Company Background:

Affiliated with US Group companies, CGLIA Solutions LLP is an innovative Software Product Development Organization developing high available, highly secure, cloud-based enterprise software products catering to the needs of Large Research facilities, University medical centres, Hospitals, Pharma companies in US and worldwide ultimately leading to the development of life saving medications.

CGLIA is known for helping Software professionals to unleash their creativity, turning them into world class professionals, and building their career.

Job Summary:

As a Software Engineer, you assist in the design development of new products for our renowned customers worldwide.

Enhancing the existing applications by identifying the areas of improvements, making recommendations and designing and implementing them. 

Ideal candidate should be a self-starter and, should have excellent problem-solving skills and passionate about developing high quality innovative products exceeding the customer expectations and needs. A keen interest for quality at every stage of development is a must.

Looking for a highly motivated individual who is looking to grow their career in a challenging environment.

Responsibilities:

• Participating in discussion with Product Management teams and Generating the Requirement Specification document that has covers both the functional and Non-functional requirements.
• Participating in discussion with the technical teams and generating the design documents.
• Develop code and update the existing code, ensuring that all the code meets the agreed upon requirements.
• Perform intensive testing of all new and existing programs to ensure they are free of errors and function as intended
• Work closely with the cross functional teams like UI Developers, Business Analysts and Management teams.
• Cultivate an environment of collaboration, commitment, accountability, and creativity and deliver products and services on time with quality delight the customer.
• Actively participating in the hiring process, for Organization growth.
• Updates job knowledge by studying latest development tools, programming techniques, and participating in professional organizations.
• Willing to undertake additional tasks and responsibilities as may be reasonably expected of the role and as necessary in order to achieve the objectives of the organization.

Qualifications: (Education, Experience, Skills and Knowledge)

·        Bachelor’s Degree in Computer Science or Information Technology or any equivalent degree.

·        At least 3 plus years of hands on experience in developing cloud-based software.

·        Expertise in developing cloud based distributed applications and must have experience in object-oriented design.

·        Strong hands on experience in using Java, Hibernate, Spring technology stack (Spring MVC, Spring Data, Spring Cloud, Spring Batch, Spring security etc.) along with open source technologies.

• Experience building web and mobile applications using frontend technologies Angular (Angular 1/Angular 2), Bootstrap, Material Design, UX/UI, JavaScript, HTML5, and CSS.

·        Experience on any one of databases like MySQL, MS SQL, PostgreSQL, and Oracle.

·        Exposure with more than one of the Software Development Methodologies.

·        Knowledge on the Code Static Analyzer tools like SonarQube, PMD etc. and, DevOps Tools.

·        Expertise in Security related to Web Applications and mobile applications. and other open source and commercial tools.

·        Ability to work independently and along with teams.

·        Impeccable written English skills, and Oral communication skills along with outstanding interpersonal skills.

·        Eagerness and willingness to learn new technologies.

Company Name – Wissen Technology

Group of companies in India – Wissen Technology & Wissen Infotech

Work Location – Whitefield, Bangalore

Website and Company profile:

www.wissen.com

LinkedIn Page:

https://www.linkedin.com/company/wissen-technology/

While you may already know about Wissen and the company history, here is a quick rundown for you.

About Wissen Technology:

·    The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015.

·    Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products.

·    Our workforce has highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like Wharton, MIT, IITs, IIMs, and NITs and with rich work experience in some of the biggest companies in the world.

·    Wissen Technology has grown its revenues by 400% in these five years without any external funding or investments.

·    Globally present with offices US, India, UK, Australia, Mexico, and Canada.

·    We offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.

·    Wissen Technology has been certified as a Great Place to Work®.

·    Wissen Technology has been voted as the Top 20 AI/ML vendor by CIO Insider in 2020.

·    Over the years, Wissen Group has successfully delivered $650 million worth of projects for more than 20 of the Fortune 500 companies.

·    We have served client across sectors like Banking, Telecom, Healthcare, Manufacturing, and Energy. They include likes of Morgan Stanley, Goldman Sachs, MSCI, StateStreet, Flipkart, Swiggy, Trafigura, GE to name a few.

About Role :

Key Responsibilities

• Build and maintain data transformation pipelines using java Spark
• Develop and optimize large-scale/CPU intensive data processing using Apache Spark
• Orchestrate workflows using Airflow
• Implement data quality checks, testing, and monitoring for pipeline. Good to have exposer into managing metadata, cataloguing, and lineage
• Support schema evolution, backfills, and incremental processing
• Ensure pipelines meet SLAs for freshness, reliability, and performance
• Expertise/working knowledge in Spark and HBase(semantic layer, virtual datasets, Reflections)

Required Skills & Qualifications

• Strong hands-on experience with 
• HBase
• Apache Spark
• Experience with HBase or similar lakehouse query engines
• Airflow 
• Understanding of data catalogs and lineage (e.g., OpenLineage, DataHub, Apache Polaris , openlineage)
• Proficiency in Java
• Experience with Git-based development and CI/CD

Nice-to-Have Skills

• OpenTable format/Iceberg ,Apache Arrow
• CDC-based analytics pipelines
• Cloud platforms (AWS)
• Kubernetes-based data platforms

Position Title : Software Engineer

Position Type: Full-Time

Department: Research & Development

Reports To: First Level Manager,

Company Background:

Affiliated with US Group companies, CGLIA Solutions LLP is an innovative Software Product Development organization developing highly available, highly secure, cloud-based enterprise software products catering to the needs of leading Research Facilities, University Medical Centers, Hospitals, and Pharmaceutical companies across the globe, ultimately contributing to the development of life-saving medications.

CGLIA is committed to helping software professionals unleash their creativity, build world-class enterprise applications, and accelerate their careers in a collaborative and innovation-driven environment.

Job Summary :

As a Software Engineer (Java), you will be responsible for designing, developing, and maintaining scalable, secure, and high-performance cloud-based enterprise applications. You will work closely with Product Management, Business Analysts, QA, DevOps, and cross-functional engineering teams to deliver innovative software solutions that exceed customer expectations.

The ideal candidate should be a self-starter with excellent analytical and problem-solving skills, strong expertise in Java backend technologies, and a passion for developing high-quality software. This role also provides an opportunity to mentor junior engineers, participate in technical discussions, and contribute to architectural decisions.

Key Responsibilities

• Participate in requirement analysis and collaborate with Product Management to understand functional and non-functional requirements.
• Contribute to technical design discussions and prepare technical design documentation.
• Design, develop, test, and maintain scalable backend applications using Java and Spring Boot.
• Develop and maintain RESTful APIs and Microservices.
• Write clean, reusable, maintainable, and well-documented code following industry best practices.
• Optimize application performance, scalability, reliability, and security.
• Perform unit testing, code reviews, debugging, and production issue resolution.
• Collaborate with QA, DevOps, UI, and Product teams throughout the software development lifecycle.
• Mentor junior engineers and actively contribute to knowledge sharing within the team.
• Stay updated with emerging technologies, frameworks, and software development best practices.
• Participate in technical interviews and hiring activities to support organizational growth.
• Undertake additional responsibilities as required to achieve project and organizational objectives.
• 
  

Qualifications (Education, Experience, Skills & Knowledge)

• Bachelor's degree in Computer Science, Information Technology, or an equivalent discipline.
• 5+ years of hands-on experience in Java application development.
• Strong expertise in Core Java (Java 8/11/17) and Object-Oriented Programming concepts.
• Extensive experience with Spring Boot, Spring MVC, Spring Data JPA, Spring Security, and Hibernate.
• Strong experience designing and developing RESTful APIs and Microservices.
• Experience working with relational databases such as MySQL, PostgreSQL, Oracle, or MS SQL Server.
• Good understanding of Data Structures, Algorithms, Design Patterns, and Multithreading.
• Angular, Bootstrap, Material Design, HTML5, CSS, JavaScript
• Hands-on experience with Git, Maven/Gradle, and Agile/Scrum development methodologies.
• Experience with code quality tools such as SonarQube and static code analysis.
• Exposure to Docker, Kubernetes, CI/CD pipelines, and cloud platforms (AWS, Azure, or GCP) is preferred.
• Knowledge of messaging systems such as Kafka or RabbitMQ is an added advantage.
• Strong analytical, troubleshooting, and debugging skills.
• Excellent written, verbal, and interpersonal communication skills.
• Ability to work independently and collaboratively in a fast-paced product development environment.
• Eagerness to learn and adopt new technologies.

Experience: 12–15 Years

Job Type: Full-time

Role: Java Lead / Technical Lead

Job Summary

We are looking for an experienced Java Lead with 12–15 years of hands-on software development experience to lead the design, development, and delivery of scalable enterprise applications. The ideal candidate should have strong expertise in Core Java, Spring Boot, Microservices, REST APIs, SQL, and cloud technologies, along with proven experience in technical leadership and mentoring development teams.

The candidate will work closely with architects, product managers, and engineering teams to translate business requirements into robust and scalable technical solutions.

Key Responsibilities

• Lead the design, development, and implementation of Java-based enterprise applications.
• Provide technical leadership and guidance to a team of Java developers.
• Design and develop scalable, secure, and high-performance microservices and RESTful APIs.
• Participate in architecture and technical design discussions and contribute to key technical decisions.
• Review code and ensure adherence to coding standards, design principles, and best practices.
• Troubleshoot complex technical issues and provide effective solutions.
• Work closely with product managers, business analysts, QA, DevOps, and other stakeholders.
• Mentor developers and conduct technical knowledge-sharing sessions.
• Identify opportunities for improving application performance, scalability, reliability, and maintainability.
• Ensure effective implementation of unit testing, integration testing, CI/CD, and automated deployment practices.
• Participate in production support, root-cause analysis, and resolution of critical issues.
• Stay updated with emerging technologies and recommend suitable solutions where applicable.

Required Skills

• 12–15 years of experience in Java/J2EE application development.
• Strong expertise in Core Java, OOP, Collections, Multithreading, Exception Handling, and Java 8+ features.
• Strong hands-on experience with Spring Framework and Spring Boot.
• Excellent experience in Microservices architecture and RESTful web services.
• Strong understanding of design patterns, SOLID principles, and software architecture.
• Good knowledge of SQL and relational databases such as PostgreSQL, MySQL, or Oracle.
• Experience with Hibernate/JPA.
• Strong understanding of data structures and algorithms.
• Experience with Git and Maven/Gradle.
• Good understanding of CI/CD pipelines and DevOps practices.
• Experience with Docker and Kubernetes is preferred.
• Exposure to cloud platforms such as AWS, Azure, or GCP.
• Experience with messaging technologies such as Kafka or RabbitMQ is an advantage.
• Strong debugging, problem-solving, and analytical skills.

Leadership & Soft Skills

• Proven experience in leading or mentoring technical teams.
• Strong communication and stakeholder-management skills.
• Ability to drive technical discussions and make sound engineering decisions.
• Ability to work effectively in a collaborative, agile environment.
• Strong ownership and accountability for technical deliverables.
• Ability to balance hands-on development with technical leadership responsibilities.

Education

Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.

Preferred Qualifications

• Experience working on large-scale, distributed enterprise applications.
• Experience with cloud-native application development.
• Knowledge of event-driven architecture.
• Experience with system design and high-level/low-level design.
• Familiarity with Agile/Scrum methodologies.

Staff Engineer - AI:

Location : India, Remote

Job Description

Egnyte is seeking an experienced Staff Software Engineer to join our Engineering department. The Engineering department builds large distributed components and services that run Egnyte's Cloud Platform. Our code serves billions of requests per day with sub-second latency in a fault-tolerant environment. We process and analyze millions of files and events daily. Some of the responsibilities for this department include Egnyte's Cloud File System, Content Classification, Content Lifecycle Management, User Behavior Analysis, Object Store, Metadata Stores, Search Systems, Recommendations Systems, Synchronization, and intelligent caching of multi-petabyte datasets. We are looking for candidates with a shared passion for building large-scale distributed systems and a keen sense for tackling complexities that come with scaling through multiple orders of magnitude.

In this role, you will (But are not limited to):

• Design and develop highly scalable and resilient cloud architecture that seamlessly integrates with on-premises systems
• Drive the team’s goals and technical direction to find and pursue technical opportunities that make Egnyte’s cloud platform more efficient
• Effectively communicate complex design and architecture details
• Understand company and industry-wide trends to help develop new technologies
• Conceptualize, develop, and implement changes that prevent key systems from becoming unreliable, under-utilized, or unsupported
• Own all aspects of critical software projects from design to implementation, QA, deployment, and monitoring

Qualifications

• BS, MS, or PhD. in Computer Science or related technical field, or equivalent practical experience
• 8-15 years of professional experience in engineering with a history of technical innovation
• Experience providing technical leadership to engineers

Bonus Qualifications (Good to Have)

• The breadth of knowledge across infrastructure domains, with the ability to reason about everything from data center machine software to database solutions to machine learning infrastructure to front-end web or mobile applications
• Demonstrated success in designing and developing large-scale, complex systems
• Expertise with multi-tenant, highly complex, cloud solutions; experience with Hybrid and/or on-premises solutions desired

About Egnyte

In a content critical age, Egnyte fuels business growth by enabling content-rich business processes, while also providing organizations with visibility and control over their content assets. Egnyte’s cloud-native content services platform leverages the industry’s leading content intelligence engine to deliver a simple, secure, and vendor-neutral foundation for managing enterprise content across business applications and storage repositories. More than 16,000 customers trust Egnyte to enhance employee productivity, automate data management, and reduce file-sharing cost and complexity. Investors include Google Ventures, Kleiner Perkins, Caufield & Byers, and Goldman Sachs. For more information, visit www.egnyte.com

Description

We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising insights and analytics. The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Spark and Scala.

You will work on designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
• Build and optimize distributed data applications using Spark and Scala.
• Develop reliable, high-performance data pipelines for batch and streaming workloads.
• Work with large datasets to ensure data quality, consistency, and performance.
• Collaborate with engineering, product, and analytics teams to deliver robust data solutions.
• Optimize data workflows for scalability, reliability, and cost efficiency.
• Deploy and manage data workloads in cloud and containerized environments.
• Troubleshoot production issues and continuously improve platform performance.

Requirements

Candidates who demonstrate:

• 5+ years of experience in Data Engineering or Big Data Engineering.
• Strong hands-on experience with Apache Spark and Scala.
• Experience building and maintaining ETL pipelines.
• Familiarity with Google Cloud Storage (GCS).
• Experience with Kubernetes (K8s).
• Strong SQL skills and understanding of distributed data processing.
• Excellent debugging, problem-solving, and performance optimization skills.
• Strong communication and collaboration skills.

Good to Have

• Experience with AWS and cloud-native data services.
• Familiarity with streaming technologies such as Kafka.
• Experience working on large-scale data platforms or AdTech systems.
• Exposure to orchestration tools such as Airflow.

Benefits

• Best-in-class salary: We hire strong talent and compensate accordingly.
• Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
• Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
• High-impact work: Build AI-first systems and products used at scale by global clients.

About Us

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.

Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.