Senior Data Engineer (ETL, Go, Databricks)

Job Description & Specification: 

Post Title: Data Engineer

Work Mode: Kochi Onsite - UK Time zone

Role Overview: 

We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have expertise in technologies such as Metabases, Dbt, Stitch, Snowflake, Avo, and MongoDB. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support our analytics and data-driven decision-making processes.

Responsibilities:

• Designing, developing and implementing scalable data pipelines and ETL processes using tools such as Stitch and Dbt to ingest, transform, and load data from various sources into our data warehouse (Snowflake).
• Implement data modeling best practices and standards using Dbt to create and manage data models for reporting and analytics.
• Collaborating with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Develop and maintain dashboards and visualizations in Metabases to enable self-service analytics and data exploration for internal teams.
• Building and optimizing ETL processes to ensure data quality and integrity.
• Optimizing data processing and storage solutions for performance, scalability and reliability, leveraging cloud-based technologies.
• Implementing monitoring and alerting systems to proactively identify and address data issues.
• Implementing data quality checks and monitoring processes to ensure the accuracy, completeness, and integrity of data.
• Managing and optimizing databases (like MongoDB for performance and scalability).
• Developing and maintaining documentation, best practices, and standards for data engineering processes and workflows.
• Stay up to date with emerging technologies and trends in data engineering, machine learning, and analytics, and evaluate their potential impact on data strategy and architecture.

Requirements:

• Bachelor's or Master's degree in Computer Science.
• Minimum of 4 years of experience working as a data engineer with expertise in Metabases, Dbt, Stitch, Snowflake, Avo, MongoDB.
• Strong programming skills in languages like Python, and experience with SQL and database technologies (e.g., PostgreSQL, MySQL, MongoDB).
• Hands-on experience with data integration tools (e.g., Stitch), data modeling tools (e.g., Dbt), and BI platforms (e.g., Metabases).
• Experience with cloud platforms such as AWS.
• Strong understanding of data modeling concepts, database design, and data warehousing principles
• Experience with big data technologies and frameworks (e.g., Hadoop, Spark, Kafka) and cloud-based data platforms (e.g., AWS EMR, Azure Databricks, Google BigQuery).
• Familiarity with data integration tools, ETL processes, and workflow orchestration tools (e.g., Apache Airflow, Apache NiFi).
• Excellent problem-solving skills and attention to detail.
• Strong communication skills with the ability to work effectively in a global team environment.
• Experience in the education or Edtech industry is a plus.
• Knowledge of Avo for schema management and versioning will be an added advantage.
• Familiarity with machine learning algorithms, data science workflows, and analytics tools (e.g., TensorFlow, PyTorch, scikit-learn, Tableau).
• Knowledge of distributed computing concepts and containerization technologies.
• Experience with version control systems (e.g., Git) and CI/CD pipelines.
• Certifications in cloud computing (e.g., AWS Certified Developer, Google Cloud Professional Data Engineer) or data engineering (e.g., Databricks Certified Associate Developer) are desirable.

Benefits:

• Competitive salary and bonus structure based on performance and achievement of goals.
• Comprehensive benefits package including medical insurance.

Join us in shaping the future of technology by applying your expertise as a Data Engineer. If you are passionate about driving innovation and delivering impactful solutions, we invite you to be part of our dynamic team. Apply now!!

Key Responsibilities:

• Design user-friendly interfaces for web and mobile applications using Figma.
• Create wireframes, UI mockups, user flows, and interactive prototypes.
• Collaborate with cross-functional teams including developers and product managers.
• Ensure consistency in design elements, styles, and branding.
• Collect and incorporate feedback to improve designs.
• Stay updated with current design trends and tools.

We are an age-tech startup revolutionising healthcare with real-time data. We are creating a connected-care ecosystem that uses AI-enabled Health Algorithms and medical devices (IoT & Wearables) to digitise medical information exchange. In short, we want to allow older adults to live independently at their homes and enjoy their moments while keeping everyone informed. Our mission is to provide doctors, carers and family relatives with predictive tools capable of picking up health problems before they become severe, therefore saving time, money and lives.

Every member of the technology team is responsible for:

• The availability, security, scalability, and interoperability of our platform

• Delivering our product roadmap

• Planning for the future

• Generating enthusiasm and a sense of both technical and product pride

As a Senior .NET Developer, you play a key role in ensuring your team can efficiently turn ideas into reality. You’ll need to:

• Write technically sound, clean, maintainable code with practical application of established patterns and practices

• Take technical ownership of your team’s work, from its infancy through to delivering great implementation in production that pushes our standards higher and higher

• Believe in testing and make sure your code is always tested and the quality standards are always high

• Contribute to the definition and keep to the processes, standards and designs your team has agreed upon

• Track the progress that you are making towards the wider goals of your team, and transparently communicate that progress to your team and Technical Lead

• Ensure you and others are continuously improve, by proposing and implementing new processes, designs and engineering practices that make the team more effective

• Take responsibility for supporting your changes all the way through proving they work well and continue to work well in production

• At least 4 years of commercial experience with C# and .NET

• At least 2 years of experience with React.js/Vue.js

• At least 2 years of commercial experience with Microsoft Azure (or AWS)

• Designing and developing APIs for both high availability and scalability

• Writing automated tests (both unit and integration tests)

• Experience with CI/CD pipelines (ideally Azure DevOps)

• TDD and BDD

• Contributing to open source community

• DevOps, monitoring and alerting

• Experience with Health-tech, FHIR, Wearables, IoT

• If you can join within 1 month

ESSENTIAL SKILLS/ATTRIBUTES:

• Excellent knowledge of Android
• Appreciation for the limitations of handset development
• Attention to detail and subtleties of UI design and implementation
• Understanding of design patterns
• Ability to design for scalability and resilience
• Strong application process flow and problem solving techniques.
• Strong focus on refactoring and code quality
• Understanding of software configuration management and release management
• High levels of software engineering literacy and communication skills
• Friendly and professional manner
• Minimum 3 - 5 years java development
• Third Level Qualifications in computing, mathematics or science

DESIRED SKILLS:

• Experience of working in an agile environment
• Product development and lifecycle experience
• Experience of unit testing
• Scripting (JavaScript, Ruby, Python, Shell, etc.)
• Knowledge of build systems such as Maven and Gradle

• Develop Magento extensions based on requirements given
• Customize 3rd party Magento extensions
• Diagnose and fix bugs in Magento websites
• Customize Magento functionalities by following Magento standards
• Optimize speed of Magento by identifying and fixing bottlenecks

• Proficient in Object-Oriented PHP, MVC, Javascript, jQuery, prototype, SQL, HTML, and CSS
• Extensive in developing Magento extensions and themes
• Deep understanding of the Magento architecture and data flow
• Thorough understanding of Magento concepts of Layouts, Blocks, Models, Controllers, Helpers, Observers, etc
• Understands the ORM concepts and database structure of Magento
• Knows how to extend Magento functionalities including REST APIs
• Understands the performance bottlenecks of Magento and the ability to write optimized code
• Knowledge in Magento 2 is an added advantage
• Knowledge in Linux environments
• Good knowledge in GIT concepts and operations
• Knows how to consume 3rd party RESTful services
• Magento Developer Certification is an added advantage

1. To implement the manpower plan in coordination with the Site Head and Department Heads and do the placements and recruitment in line with the recruitment procedures, for all categories and ensure that the manpower strength is always maintained within the budged level.
2. To handle the administration of all human resources / personnel systems including performance appraisal systems in respect of all employees of the Site.
3. To prepare training plan in consultation with Operations Head and in coordination with all and Department Heads and ensure implementation.
4. To ensure that the training records including identified training needs of all employees are maintained and to assist in preparation of Training plan.
5. To maintain the Training Hall including the equipments / aids etc.,
6. To Co – ordinate and ensure that the evaluation / assessment of all trainees / Probationers of all category and to implement the recommendations.
7. To conduct the Annual Performance Appraisal exercise with a view to maintain and boost the morale of the employees.
8. To create a culture to induce personal as well as organization development.
9. To ensure that the requirements of health & safety measures for the Site are adhered to and complied with.
10. To ensure that the dossier/personnel data of all employees are maintained up-to date and provide the data as and when required.