Human Resources (HR) Generalist

Senior Data Engineer Job Description

Overview

The Senior Data Engineer will design, develop, and maintain scalable data pipelines and

infrastructure to support data-driven decision-making and advanced analytics. This role requires deep

expertise in data engineering, strong problem-solving skills, and the ability to collaborate with

cross-functional teams to deliver robust data solutions.

Key Responsibilities

Data Pipeline Development: Design, build, and optimize scalable, secure, and reliable data

pipelines to ingest, process, and transform large volumes of structured and unstructured data.

Data Architecture: Architect and maintain data storage solutions, including data lakes, data

warehouses, and databases, ensuring performance, scalability, and cost-efficiency.

Data Integration: Integrate data from diverse sources, including APIs, third-party systems,

and streaming platforms, ensuring data quality and consistency.

Performance Optimization: Monitor and optimize data systems for performance, scalability,

and cost, implementing best practices for partitioning, indexing, and caching.

Collaboration: Work closely with data scientists, analysts, and software engineers to

understand data needs and deliver solutions that enable advanced analytics, machine

learning, and reporting.

Data Governance: Implement data governance policies, ensuring compliance with data

security, privacy regulations (e.g., GDPR, CCPA), and internal standards.

Automation: Develop automated processes for data ingestion, transformation, and validation

to improve efficiency and reduce manual intervention.

Mentorship: Guide and mentor junior data engineers, fostering a culture of technical

excellence and continuous learning.

Troubleshooting: Diagnose and resolve complex data-related issues, ensuring high

availability and reliability of data systems.

Required Qualifications

Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science,

or a related field.

Experience: 5+ years of experience in data engineering or a related role, with a proven track

record of building scalable data pipelines and infrastructure.

Technical Skills:

Proficiency in programming languages such as Python, Java, or Scala.

Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).

Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services

(e.g., Redshift, BigQuery, Snowflake).

Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and

data integration frameworks.

Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed

systems.

Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a

plus.

Soft Skills:

Excellent problem-solving and analytical skills.

Strong communication and collaboration abilities.

Ability to work in a fast-paced, dynamic environment and manage multiple priorities.

Certifications (optional but preferred): Cloud certifications (e.g., AWS Certified Data Analytics,

Google Professional Data Engineer) or relevant data engineering certifications.

Preferred Qualifica

Experience with real-time data processing and streaming architectures.

Familiarity with machine learning pipelines and MLOps practices.

Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data

pipelines.

Experience in industries with high data complexity, such as finance, healthcare, or

e-commerce.

Work Environment

Location: Hybrid/Remote/On-site (depending on company policy).

Team: Collaborative, cross-functional team environment with data scientists, analysts, and

business stakeholders.

Hours: Full-time, with occasional on-call responsibilities for critical data systems.

 About us:

http://www.productsup.com">Productsup provides an award-winning platform for feed management, product content syndication, marketplace integration, and seller onboarding. The platform empowers businesses to take complete control of their product data and break through the digital walls that hinder growth. With Productsup, businesses can syndicate content to digital marketing, shopping, or business channels, including Google, Amazon, Facebook, Walmart, and more. 

We are headquartered in Berlin, Germany, have entities in 5 different countries, and are in the process of setting up our Indian entity. Productsup is trusted by more than 800 businesses worldwide, including 5 Fortune 20 companies and market leaders like IKEA, Walmart, Superdry, and Rakuten.

We are proud that we have recently raised an additional 20 Million dollars in funding and that our employees enjoy working at Productsup, which is also shown by our Glassdoor and Kununu ratings.

About the role:

We’re looking for a hands-on Engineering Lead/Managing Architect for our API/Backend Development team. In this role, you’ll lead the effort to develop channels and APIs for our marketplace channels and scalable data pipelines, which process over 5 billion products a day.

In your first 6 months and beyond, you will:

• Learn the ins and outs of our platform, our codebase and our engineering processes
• Help build features for software that works with large data sets
• Play a key cross-functional role within our team of highly talented Javascript and PHP developers
• Develop solutions for high availability software
• Receive customer requests from the Product Team and develop solutions in the form of new features or products
• Debug and maintain APIs
• Work closely within the Platform team and with the API team to develop internal APIs and client-facing interfaces.

What you bring to the team:

• 2+ years of demonstrated Tech leadership experience.
• 7+ years of experience in PHP (good knowledge of Slim, Silex, or Symfony frameworks) and MySQL
• Some knowledge of integration architecture patterns such as scalable microservices, API gateways, API scalability
• Deep knowledge in APIs, web services, command-line programs, TDD, and SOLID design principles
• Good understanding of B2B SaaS products and experience dealing with big data
• Knowledge of developing and securing APIs
• Extended database experience in Elasticsearch, MongoDB or Couchbase
• Outstanding communication skills in English
• Educational background in IT or Computer Science is a plus

Benefits & Perks:

• Attractive Salary and benefits
• MacBook (latest version) for our new joiners
• A unique and thorough onboarding program where you’ll learn the ins and outs of our company and product
•  
• Employee referral bonuses
• High level of personal responsibility and impact

Explore more here

https://www.linkedin.com/company/productsup/">LinkedIn 

https://www.youtube.com/watch?v=olqMdYTBjHc">Life at Productsup

Do you have what it takes? We'd love to hear from you!

We know CVs don't always tell the whole story, so in addition to submitting your CV feel free to let us know why you're interested in this role in a short cover letter (:100 words).

• Develop new user-facing features
• Build reusable code and libraries for future use
• Ensure the technical feasibility of UI/UX designs
• Optimize application for maximum speed and scalability
• Assure that all user input is validated before submitting to back-end
• Collaborate with other team members and stakeholders

• Proficient understanding of web markup, including HTML5, CSS3
• Basic understanding of server-side CSS pre-processing platforms, such as LESS and SASS
• Proficient understanding of client-side scripting and JavaScript frameworks, including jQuery
• Good understanding and knowledge of advanced JavaScript libraries and frameworks, such as AngularJS, KnockoutJS, BackboneJS, ReactJS, DurandalJS etc.
• Good understanding of asynchronous request handling, partial page updates, and AJAX
• Basic knowledge of image authoring tools, to be able to crop, resize, or perform small adjustments on an image
• Proficient understanding of cross-browser compatibility issues and ways to work around them.
• Proficient understanding of code versioning tools, such as Git
• Good understanding of SEO principles and ensuring that application will adhere to them