Technical Architect

Role: GCP Data Engineer

Notice Period: Immediate Joiners

Experience: 5+ years

Location: Remote

Company: Deqode

About Deqode

At Deqode, we work with next-gen technologies to help businesses solve complex data challenges. Our collaborative teams build reliable, scalable systems that power smarter decisions and real-time analytics.

Key Responsibilities

• Build and maintain scalable, automated data pipelines using Python, PySpark, and SQL.
• Work on cloud-native data infrastructure using Google Cloud Platform (BigQuery, Cloud Storage, Dataflow).
• Implement clean, reusable transformations using DBT and Databricks.
• Design and schedule workflows using Apache Airflow.
• Collaborate with data scientists and analysts to ensure downstream data usability.
• Optimize pipelines and systems for performance and cost-efficiency.
• Follow best software engineering practices: version control, unit testing, code reviews, CI/CD.
• Manage and troubleshoot data workflows in Linux environments.
• Apply data governance and access control via Unity Catalog or similar tools.

Required Skills & Experience

• Strong hands-on experience with PySpark, Spark SQL, and Databricks.
• Solid understanding of GCP services (BigQuery, Cloud Functions, Dataflow, Cloud Storage).
• Proficiency in Python for scripting and automation.
• Expertise in SQL and data modeling.
• Experience with DBT for data transformations.
• Working knowledge of Airflow for workflow orchestration.
• Comfortable with Linux-based systems for deployment and troubleshooting.
• Familiar with Git for version control and collaborative development.
• Understanding of data pipeline optimization, monitoring, and debugging.

Experience with deploying applications on cloud infrastructure, preferably AWS

• Experience in using REST APIs with the front end

• Experience in handling webMap applications using leading webMap Javascript APIs like ReactJS Leaflet, Google Maps Javascript API and Geoserver management

• Experience with the Agile/Scrum development model

• Strong experience in code versioning using Git.

• Strong design, development, and implementation experience.

• Very good experience in React JS, React Leaflet and Redux

Technologies & Languages

• Azure
  • Databricks
  • SQL Sever
  • ADF
• Snowflake
  • Data Cleaning
  • ETL
• Azure Devops
• Intermediate Python/Pyspark
• Intermediate SQL
• Beginners' knowledge/willingness to learn Spotfire
• Data Ingestion
• Familiarity with CI/CD or Agile

Must have:

• Azure – VM, Data Lake, Data Bricks, Data Factory, Azure DevOps
• Python/Spark (PySpark) 
• SQL

Good to have:

• Docker
• Kubernetes
• Scala

He/she should have a good understanding in:

• How to build pipelines – ETL and Injection
• Data Warehousing
• Monitoring

Responsibilities:

Must be able to write quality code and build secure, highly available systems.

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc with the guidance.

Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

Monitoring performance and advising any necessary infrastructure changes.

Defining data retention policies.

Implementing the ETL process and optimal data pipeline architecture

Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.

Create design documents that describe the functionality, capacity, architecture, and process.

Develop, test, and implement data solutions based on finalized design documents.

Work with data and analytics experts to strive for greater functionality in our data systems.

Proactively identify potential production issues and recommend and implement solutions

Are you passionate in coding and blockchain? Do you wish to face challenges ahead, develop and deliver features that will be extraordinary towards users? We are looking for experienced talents (React JS / Node JS / MongoDB / Web3.js / Solidity developers) to join our team and start a revolution!

Key Responsibilities and Scope

• Framework development and integration
• Prototype and Proof of concept development
• Creation, configuration, and monitoring Shards sets. Architecture and capacity planning for MongoDB clusters. 
• Assisting senior developers in detecting performance issues in the system by deploying MMS and MongoDB profilers
• Implementation of MongoDB advanced concepts like locking, transactions, indexes, Sharding, replication, schema design. 
• Maintain MongoDB replication with replica set factors, arbiters, voting, priority, server distribution, slave delays. 

Technical Skills

- Database & Languages:  MongoDB, B-tree, MongoDB Profiler, Javascript, MongoDB Compass, Mongo Booster

- Others: Elastic Stack, MMS, MongoDB Management service

Qualifications and Experience location GMT+8 or GMT+5:30

• Ability to work remotely or on-site (if Malaysia)
• Executing elastic stack in production scale Passion for best design, developing, and coding practices
• Creating servers and databases for functionality
• Maximizing application performance, uptime, and scalability, maintaining high standards of code quality and thoughtful application design
• Excellent debugging and optimization skills
• Unit/integration testing experience
• Experience in analyzing and visualizing the data along with data modeling
• Experience in upgrading different databases and also migration of data among multiple databases. 
• Experience in MongoDB installation, patching, troubleshooting, performance, tracking/tuning, backup, and recovery in dynamic environments. 
• Experience in managing the life cycle of MongoDB including sizing, automation, monitoring, and tuning
• Experience in working with MongoDB ops Manager, Cloud Manager, and Atlas Manager
• Experience in analyzing chunk migrations, splitting, and balancing across the clusters.

• Own Android SDKs, working hand-in-hand with the founding team
• Design and build delightful user interfaces for native apps on Android
• You will be (co-) responsible for our software development kit (SDK) for Android
• Building mobile apps in both Swift and Kotlin.
• You work independently on your own code, but you also spend time collaborating with others.
• You are involved in all stages of app development and contribute to the roadmap.
• You get the freedom to experiment with new Android technology.
• Ownership — advocate for projects and solutions that need to be launched ground up.

• Min 2 to 4 years in developing Android applications in Java / Kotlin / C++ /
• Gradle/Groovy.
• Worked on SDKs/Frameworks.
• Strong understanding of software design patterns as well as Android specifics.
• Experience with authenticated sessions using authentication tokens and have at-least
• fundamental knowledge of app security.
• Good to have:-
• Experience with Cross-platform frameworks is a plus (React Native, Flutter, Cordova,
• Xamarin).
• Have implemented security standards and guides.
• Experience building applications at scale.
• Experience with third-party libraries and APIs like Mobile Vision, MLKit and/or
• Camera API.
• Good understanding of garbage collection, design patterns and continuously
• discover, evaluate, and implement new technologies to maximise development
• efficiency.
• Unit-test code for robustness, including edge cases, usability, and general
• reliability

• The ideal candidate will have experience in development teams that work on business facing transactional systems.
• They will have demonstrated the ability to manage people, make architectural decisions, understand business
• processes to deliver the cleanest solutions.
• Share responsibility for implementing the firms accounting platforms. Partner with 3 rd parties (like Consulting Firms)
• and develop technical specifications.
• Share responsibility for availability, scalability, performance and capacity from development through production
• for a critical strategic build of the new accounting platform
• Reduce errors on deployments, improve reliability, and increase speed of implementation through automation
• Continuously refine and improve our toolset to improve our data and persistence layers

• 7+ years of experience in IT including some experience in architecture roles
• Experience building multi-tier, scalable, fault-tolerant web applications
• Experience with platform integrations and designing service APIs
• Extensive Service-Oriented Architecture patterns and design knowledge and familiarity with cloud based services
• Expertise with identity management, authentication and information security best practices
• Expertise in working with complex cross-domain applications in a global organization across multiple time zones
• Enjoys a fast paced, high-intensity and complex environment, troubleshooting time sensitive critical issues and working with people
• Extensive experience with multi-tier transactional architecture and design
• Extensive experience in enterprise software development in Java and web development stacks (Angular, NodeJS, HTML & CSS)
• Experience with Sybase, Cassandra
• Event / Stream processing technologies
• Experience using Agile methodologies – previous experience working from a backlog, sprints, retrospectives etc.
• Passionate about test driven, clean code, automatically tested and continuous deployment
• Excellent analytical and problem-solving skills
• Strong interpersonal skills with ability to present and convey ideas
• Strong attention to detail; action-oriented attitude, and willingness to roll up sleeves
• Curious to explore emerging technologies and learn new things
• Use metrics to drive decision making
• Undergraduate degree in Computer Science or similar discipline, Masters degree preferred
• Experience in the financial services industry is preferred                                                                                                                         

What you need to have: