Pixis AI

Key Responsibilities:

• Design, build, and maintain scalable, real-time data pipelines using Apache Flink (or Apache Spark).
• Work with Apache Kafka (mandatory) for real-time messaging and event-driven data flows.
• Build data infrastructure on Lakehouse architecture, integrating data lakes and data warehouses for efficient storage and processing.
• Implement data versioning and cataloging using Apache Nessie, and optimize datasets for analytics with Apache Iceberg.
• Apply advanced data modeling techniques and performance tuning using Apache Doris or similar OLAP systems.
• Orchestrate complex data workflows using DAG-based tools like Prefect, Airflow, or Mage.
• Collaborate with data scientists, analysts, and engineering teams to develop and deliver scalable data solutions.
• Ensure data quality, consistency, performance, and security across all pipelines and systems.
• Continuously research, evaluate, and adopt new tools and technologies to improve our data platform.

Skills & Qualifications:

• 3–6 years of experience in data engineering, building scalable data pipelines and systems.
• Strong programming skills in Python, Go, or Java.
• Hands-on experience with stream processing frameworks – Apache Flink (preferred) or Apache Spark.
• Mandatory experience with Apache Kafka for stream data ingestion and message brokering.
• Proficiency with at least one DAG-based orchestration tool like Airflow, Prefect, or Mage.
• Solid understanding and hands-on experience with SQL and NoSQL databases.
• Deep understanding of data lakehouse architectures, including internal workings of data lakes and data warehouses, not just usage.
• Experience working with at least one cloud platform, preferably AWS (GCP or Azure also acceptable).
• Strong knowledge of distributed systems, data modeling, and performance optimization.

Nice to Have:

• Experience with Apache Doris or other MPP/OLAP databases.
• Familiarity with CI/CD pipelines, DevOps practices, and infrastructure-as-code in data workflows.
• Exposure to modern data version control and cataloging tools like Apache Nessie.

Key Responsibilities:

• Design, develop, and maintain scalable and robust full-stack applications using

cutting-edge technologies.

• Collaborate with product managers, designers, and other stakeholders to

understand requirements and translate them into technical specifications.

• Implement front-end and back-end features with a focus on usability,

performance, and security.

• Write clean, efficient, and maintainable code while following best practices and

coding standards.

• Conduct code reviews, provide constructive feedback, and mentor junior

developers to foster a culture of continuous improvement.

• Troubleshoot and debug issues, identify root causes, and implement solutions to

ensure smooth application operation.

• Stay updated on emerging technologies and industry trends and apply them to

enhance our software development process and capabilities.

Requirements & Skills:

• Bachelor’s degree in computer science, Engineering, or a related field.

• 4+ years of professional experience in software development, with a focus on fullstack development.

• Proficiency in programming languages such as JavaScript (Node.js), Python, orJava.

• Experience with front-end frameworks/libraries such as React, Angular, or Vue.js.

• Solid understanding of back-end frameworks/libraries such as Express.js, Django, or Spring Boot.

• Experience with database systems (SQL and NoSQL) and ORMs (e.g., Sequelize, SQLAlchemy, Hibernate).