Pega

Job Title: Senior Data Engineer

No. of Positions: 3

Employment Type: Full-Time, Permanent

Location: Remote (Pan India)

Shift Timings: 10:00 AM – 7:00 PM IST

Experience Required: Minimum 3+ Years

Mandatory Skills: Scala & PySpark

Role Overview

We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and architectures. The ideal candidate should have hands-on experience working with Big Data technologies, distributed systems, and ETL pipelines. You will work closely with cross-functional teams including Data Analysts, Data Scientists, and Software Engineers to ensure efficient data flow and reliable data infrastructure.

Key Responsibilities

• Design and build scalable data pipelines for extraction, transformation, and loading (ETL) from various data sources.
• Enhance internal processes by automating tasks, optimizing data workflows, and improving infrastructure performance.
• Collaborate with Product, Engineering, Data, and Business teams to understand data needs and provide solutions.
• Work closely with machine learning and analytics teams to support advanced data modeling and innovation.
• Ensure systems are highly reliable, maintainable, and optimized for performance.

Required Qualifications & Skills

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 3+ years of hands-on experience in Data Engineering.
• Strong experience with Apache Spark, with solid understanding of distributed data processing.
• Proficiency in Scala and PySpark is mandatory.
• Strong SQL skills and experience working with relational and non-relational data.
• Experience with cloud-based data platforms (preferably Databricks).
• Good understanding of Delta Lake architecture, Parquet, JSON, CSV, and related data file formats.
• Comfortable working in Linux/macOS environments with scripting capabilities.
• Ability to work in an Agile environment and deliver independently.
• Good communication and collaboration skills.
• Knowledge of Machine Learning concepts is an added advantage.

Reporting

• This role will report to the CEO or a designated Team Lead.

Benefits & Work Environment

• Remote work flexibility across India.
• Encouraging and diverse work culture.
• Paid leaves, holidays, performance incentives, and learning opportunities.
• Supportive environment that promotes personal and professional growth.

Responsibilities:

• Designing and Programming web based application and backend system.

• Testing and debugging application

• Analyze requirements and propose appropriate solutions

• Work independently and in teams

• Communicate effectively with project managers, designers, QA team

Requirements

• 2+ years of software development experience

• Essential skills: PHP, MySQL, HTML, CSS, JavaScript, AJAX

• Code Ignitor and Laravel development experience a big plus

• Advanced knowledge of SQL is important

• Should be able to analyze requirements and design robust system

• Good oral and written communication skills

• Ability to work in a team-oriented and collaborative environment

• BS/MS degree in Computer Science, Engineering or a related subject

What you need to have:

As an Architect, you would be expected to:

• Own the overall architectural decisions, design, and development of technology.
• Lead a multi-disciplinary team responsible for the full lifecycle of product development and testing.
• Play a significant role in the career development of others. Work with engineering teams to provide continuous architecture and design mentor-ship / leadership and be a source of support that ensures successful product delivery and operational excellence in production.
• Actively participate in design reviews, improve product delivery and align teams across the organization towards coherent architectural strategies.
• Deliver artifacts that set the standard in your organization for engineering excellence, from designs to algorithms to implementations.
• Help others understand when it is appropriate to create new versus reuse or extend existing software solutions.
• You will develop systems, component architectures, and APIs that meet the test of time. Articulate and evangelize architectural principles that ensure that system components fit and last and align with the company's business direction.

You would be a good fit if:

• You will have worked in past faced product companies and at least 8 years of experience
• Should have been part of scalable product development cycles with either large data handling or large transaction processing exposure.
• You will also possess a good understanding of object-oriented design, algorithms, Web Applications Architectures, and Microservices.
• Experience developing cloud software services and an understanding of design for scalability, performance, and reliability
• Champion a culture of innovation, in an environment that requires high levels of scalability, security, and reliability.
• You are an excellent collaborator & communicator. You know that start-ups are a team sport. You listen to others, aren’t afraid to speak your mind and always try to ask the right questions. You are excited by the prospect of working in a distributed team and company.
• Solid coding skills with the ability to drive teams through massive refactoring exercises & improve coding standards across large codebases.
• Hungry to make an impact ethically and effectively, with deep empathy for end consumers.
• Any open-source code or contributions to OSS projects would be a bonus!

What do we offer?

• A multicultural and diverse team of colleagues from all over the globe Mission-driven and fast-paced, entrepreneurial environment
• Competitive salary and other benefits
• Hybrid of work-from-home and work-from-office with full management support during Covid time
• A collaborative and flat company culture

What’s in it for you?

Do you truly want to make a difference and revolutionize the lives of millions of business owners? Do you thrive in an environment where moving at light speed and embracing new challenges every day is essential? If yes, Lummo (earlier BukuKas) is the perfect place for you!