Business Developer

Senior Data Engineer

Experience: 5+ years

Chennai/ Trichy (Hybrid)

Type: Fulltime

Skills: GCP + Airflow + Bigquery + Python + Docker

The Role

As a Senior Data Engineer, you own new initiatives, design and build world-class platforms to measure and optimize ad performance. You ensure industry-leading scalability and reliability of mission-critical systems processing billions of real-time transactions a day. You apply state-of-the-art technologies, frameworks, and strategies to address complex challenges with Big Data processing and analytics. You work closely with the talented engineers across different time zones in building industry-first solutions to measure and optimize ad performance.

What you’ll do

● Write solid code with a focus on high performance for services supporting high throughput and low latency

● Architect, design, and build big data processing platforms handling tens of TBs/Day, serve thousands of clients, and support advanced analytic workloads

● Providing meaningful and relevant feedback to junior developers and staying up-to-date with system changes

● Explore the technological landscape for new ways of producing, processing, and analyzing data to gain insights into both our users and our product features

● Design, develop, and test data-driven products, features, and APIs that scale

● Continuously improve the quality of deliverables and SDLC processes

● Operate production environments, investigate issues, assess their impact, and develop feasible solutions.

● Understand business needs and work with product owners to establish priorities 

● Bridge the gap between Business / Product requirements and technical details

● Work in multi-functional agile teams with end-to-end responsibility for product development and delivery

Who you are

● 3-5+ years of programming experience in coding, object-oriented design, and/or functional programming, including Python or a related language

● Love what you do and are passionate about crafting clean code, and have a steady foundation.

● Deep understanding of distributed system technologies, standards, and protocols, and have 2+ years of experience working in distributed systems like Airflow, BigQuery, Spark, Kafka Eco System ( Kafka Connect, Kafka Streams, or Kinesis), and building data pipelines at scale.

● Excellent SQL, DBT query writing abilities, and data understanding

● Care about agile software processes, data-driven development, reliability, and responsible experimentation 

● Genuine desire to automate decision-making, processes, and workflows

● Experience working with orchestration tools like Airflow

● Good understanding of semantic layers and experience in tools like LookerML, Kube

● Excellent communication skills and a team player

● Google BigQuery or Snowflake

● Cloud environment, Google Cloud Platform 

● Container technologies - Docker / Kubernetes

● Ad-serving technologies and standards 

● Familiarity with AI tools like Cursor AI, CoPilot.

Data Strategy and Planning:

Collaborate with stakeholders to develop and implement data management strategies aligned with business objectives.

Define data standards, policies, and procedures to ensure consistent and accurate data collection and storage.

Data Collection and Integration:

Identify and assess various data sources, both internal and external, to gather relevant and reliable data.

Design and implement data collection methods and processes to ensure data is captured efficiently.

Oversee data integration initiatives to consolidate data from different sources into a unified database.

Data Quality Assurance:

Develop and enforce data quality standards to ensure the accuracy, completeness, and consistency of data.

Implement data validation processes and routines to identify and rectify data discrepancies or errors.

Database Management:

Maintain and optimize data storage systems, including databases, data warehouses, and data lakes.

Ensure data security and compliance with relevant data protection regulations.

Data Analysis and Reporting:

Collaborate with analysts to provide clean and structured data for analysis.

Assist in creating data visualizations and reports to communicate insights and findings to stakeholders.

Team Collaboration:

Work closely with IT teams, data scientists, analysts, and other stakeholders to define data requirements and resolve technical issues.

Provide guidance and training to team members regarding data management best practices.

• Strong working knowledge of Typescript, MongoDB, MySQL, Express

• Strong proficiency in TypeScript, JavaScript including DOM manipulation and the JavaScript object model, ES6

• Hands-on experience in React JS

• Strong understanding of HTML5, CSS3

• Strong understanding of NodeJS fundamentals

• Knowledge and experience working with PostgreSQL is a major plus

• Experience with ORM libraries

• Familiarity with RESTful APIs

• Knowledge of tools like Git, GitHub, JIRA, Cucumber, Jasmine, and others that make coding more efficient and easier to share
• Familiarity of working in either the AWS Cloud or Azure including Docker + Kubernetes based microservice deployment.

Desired Candidate Profile

• Bachelors/Masters' degree in related field
• 4-6 years of experience in PR, branding or a related field
• Excellent verbal and written communication skills
• Excellent organisational skills and attention to detail
• Prior B2B or startup experience preferred    

• Writing reusable, testable, and efficient code.
• Perform Code reviews of other team members.
• Design and implementation of low-latency, high-availability, and performant applications
• Integration of user-facing elements developed by front-end developers with server-side logic
• Implementation of security and data protection
• Integration of data storage solutions.
• Liaise with the product management team and architect the application / improve the architecture wherever necessary.

Skills And Qualifications

• 7+ years of the overall experience.
• Strong Practical knowledge and understanding of RESTful API
• Excellent Python coding skills and understanding of Python best practices (PEP8)
• Should handle a team of minimum 4 members
• Excellent detail-oriented, problem-solving skills and the ability to quickly learn and apply new concepts, principles, and solutions
• 7+ years of good hands-on experience in Python, with knowledge of Django
• Good hands-on experience in SQL Database (MYSQL / Postgres)
• Familiarity of Front End Development ( ReactJS )
• Knowledge of user authentication and authorization between multiple systems, servers, and environments
• Able to create database schemas that represent and support business processes.
• Strong unit test and debugging skills
• Proficient understanding of code versioning tools GIT.
• Has experience of working in an Agile Environment.
• Fluent in English (written and oral) Fluency in a second language is preferred.
• Comfortable working remotely with great communication skills for a remote work environment.

Bonus qualifications

• Knowledge of any cloud. ( Especially Azure )