Senior GCP Data engineer

We are looking for skilled Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will play a pivotal role in optimizing data flow, ensuring scalability, and enabling seamless access to structured/unstructured data across the organization. This role requires technical expertise in Python, SQL, ETL/ELT frameworks, and cloud data warehouses, along with strong collaboration skills to partner with cross-functional teams.

Company: BigThinkCode Technologies

URL:

Location: Chennai (Work from office / Hybrid)

Experience: 4 - 6 years

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines to process structured and unstructured data.
• Optimize and manage SQL queries for performance and efficiency in large-scale datasets.
• Experience working with data warehouse solutions (e.g., Redshift, BigQuery, Snowflake) for analytics and reporting.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
• Experience in Implementing solutions for streaming data (e.g., Apache Kafka, AWS Kinesis) is preferred but not mandatory.
• Ensure data quality, governance, and security across pipelines and storage systems.
• Document architectures, processes, and workflows for clarity and reproducibility.

Required Technical Skills:

• Proficiency in Python for scripting, automation, and pipeline development.
• Expertise in SQL (complex queries, optimization, and database design).
• Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, dbt, AWS Glue).
• Experience working with structured data (RDBMS) and unstructured data (JSON, Parquet, Avro).
• Familiarity with cloud-based data warehouses (Redshift, BigQuery, Snowflake).
• Knowledge of version control systems (e.g., Git) and CI/CD practices.

Preferred Qualifications:

• Experience with streaming data technologies (e.g., Kafka, Kinesis, Spark Streaming).
• Exposure to cloud platforms (AWS, GCP, Azure) and their data services.
• Understanding of data modelling (dimensional, star schema) and optimization techniques.

Soft Skills:

• Team player with a collaborative mindset and ability to mentor junior engineers.
• Strong stakeholder management skills to align technical solutions with business goals.
• Excellent communication skills to explain technical concepts to non-technical audiences.
• Proactive problem-solving and adaptability in fast-paced environments.

If interested, apply / reply by sharing your updated profile to connect and discuss.

Regards

Job Description: As a .NET + Angular Developer, you will be responsible for developing and maintaining web applications using .NET technologies and Angular. You will work on a variety of projects, including the design and implementation of RESTful APIs, microservices, and front-end components. Your role will involve applying best practices in software development, including test-driven development (TDD) and automated unit testing, to ensure the delivery of high-quality software solutions.

Key Responsibilities:

• Develop and Maintain Applications: Design, develop, and maintain web applications using .NET, C#, ASP.NET, and Angular.
• RESTful API Development: Create and manage RESTful APIs to enable seamless integration between front-end and back-end systems.
• Microservices Architecture: Work on microservices-based architectures to enhance scalability and maintainability of applications.
• Automated Unit Testing: Implement automated unit tests to ensure code quality and reliability.
• Test-Driven Development (TDD): Apply TDD principles to write efficient and effective code.
• Database Management: Design and manage databases using MSSQL, ensuring data integrity and performance.
• Collaboration: Work closely with cross-functional teams, including front-end developers, UX/UI designers, and product managers, to deliver high-quality software solutions.
• Documentation: Maintain comprehensive documentation for code, APIs, and system architecture.

Required Skills and Qualifications:

• Proficiency in .NET Technologies: Strong experience with .NET, C#, and ASP.NET.
• Front-End Development: Expertise in Angular for building dynamic and responsive user interfaces.
• RESTful APIs: Experience designing and consuming RESTful APIs.
• Microservices: Knowledge of microservices architecture and implementation.
• Database Skills: Proficiency in MSSQL for database design and management.
• Automated Unit Testing: Experience with automated unit testing frameworks and tools.
• Test-Driven Development: Familiarity with TDD methodologies and best practices.
• Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot and resolve issues efficiently.
• Communication: Excellent verbal and written communication skills.

Preferred Qualifications:

• Experience with additional front-end frameworks or libraries.
• Knowledge of DevOps practices and tools.
• Familiarity with Agile methodologies.

What We Offer:

• Competitive salary and benefits package.
• Opportunities for professional growth and development.
• Collaborative and inclusive work environment.
• Flexible working hours and remote work options (if applicable).

Role Objective:

The objective of the developer is to design and develop solutions while being responsible for the coding standards, security and compliance requirements. 

Roles & Responsibilities:

• Business Understanding
• Understands the business requirements clearly to a level that enables in making micro decisions. Involves in designing, developing, testing software solutions 
• Arch/Design Documentation
• Clear documentation of the workflows, maintains clean code and support in solution architecture/design documentations 
• Dev Testing & Solution
• Engages in identifying & troubleshooting various website issues and coding problems; Evaluates and implements new tools based on the requirement and ensures the high performance of all systems developed; Involves in performing the code review and refactor to ensure the code quality based on the best practices and code conventions. 
• Understanding Coding Standards, Compliance & Info-security, Non-functional Requirement
• Identifies security requirements of data-in-transit and data-at-rest and discovers the vulnerabilities of the third-party components/libraries used in the application and remediating vulnerabilities; Maintains updated knowledge of the development industry, advancements in technology, and its implementation. 
• Stakeholder Management
• Collaborates with members to consistently improve the functionality and client centric solutions; Collaborate with the peers and team members to create an intuitively easy to use solution for our end users; Assists the DevOps team to manage the environment and releases; Provides training and support to junior developers. 

Requirements

• Frameworks & Libraries:
• Dot net Core
• Entity Framework
• Backend languages: C#
• Database Concepts & Applications:
• Entity framework, ADO.Net, Dapper
• Should be familiar with any of the relational databases like Postgres, SQLServer, Oracle etc., or non relational databases like MongoDB, Cassandra, etc.,
• Should be familiar with concepts: Normalization, Indexing, Joins
• Unit Testing: Should be familiar with NUnit
• Log frameworks: Should be familiar with any one of the logging libraries like Nlog or Log4Net
• Authorization & Authentication:
• Token Based Auth
• JWT with refresh token
• Claims & Identity
• SSO
• Basic Authentication
• OAuth
• Build Tools: dot net cli build commands
• Version Control: Experience in using GIT
• Other Development tools:
• Swagger Editor
• Postman/Flutter
• VSCode
• Application performance management: Nice to have basic knowledge in any of the APM Tools like AppDynamics, DataDog, NewRelic, Dynatrace, etc.,
• Vulnerability tests: Nice to have basic knowledge on security principles like OWASP Top Te etc.,
• Cloud Services: Nice to have experience in any one of the cloud services like GCP, AWS, Azure, etc.,
• CI/CD understanding: Basic understanding of pipelines and deployments
• Others:
• Common application/ web security and OWASP vulnerabilities
• Encryption algorithms to protect sensitive information
• PII, PCI, HIPPA, and GDPR compliance and how to implement
• Finding the vulnerabilities of the third-party components/ libraries
• Understanding security breaches of data-in-transit and data-at-rest and its implementation
• Behavioral Competencies:
• Accountability
• Adaptive to change
• Business communication
• Customer Focus
• Learning Agility
• Planning & organizing
• Problem solving

Purpose of Job is to strategize, manage & execute Training framework for the organization

Technical Skills

• Sound knowledge of Industry L&D Practices

• Moderate knowledge of BFSI Sector & Products

• Content creation & LMS framework understanding

• ROI Measurement tools

• Kirkpatrick Evaluation Matrix

• Animation & Simulation expertise

  
  
  

Job Responsibilities :

Team Management

⮚ Manage a team of Learning specialist and driving various Learning Initiatives on LMS, Classroom, Virtual platforms

⮚ Upskill the team periodically on Training Tools like Impact Evaluation, Content Creation, Data Reporting, etc

Impact Oriented Initiatives

⮚ Roll out Department wise Sustainable training initiatives with Impact Oriented objective & measurement of ROI

⮚ Analyzing the training need & identifying tools and matrices determining the overall impact on business

Stakeholder Management

⮚ Regular interaction & Collaboration with Stakeholders and gathering Short-term & Long-term training needs and actualizing in the Training Calendar

⮚ Publishing Training MIS & Impact reports to stakeholders and fulfilling their training asks alongside launching sustainable training initiatives

MIS & Analytics
⮚ Having a strong hold on Reporting of Data related to Training, for eg. Reports, Content, Assessment, Feedback Scores, etc.

⮚ Periodic Reporting of Training reports to stakeholders

Content Creation

⮚ Developing content based on identified competencies for all Management levels on Soft Skills, Behavioral, Leadership skills, etc.

⮚ Conduct Pre & Post Analysis as required to match Executive expectations and design Content in retrospect to expectations

Qualification :

• Any graduate

• Work experience- Minimum 12-15 years, 5+ years in Training & 3 + years Team Handling

• Preferred from BFSI or MFI

• Aged below 37 years

• Certification in Learning & Development will be an added advantage.

• Perform installation, setup, and configuration of hardware such as x86-based servers, NAS storage systems, Troubleshooting capabilities of Windows Server OS, Sound knowledge of AD, DNS, Group policy etc, tape drives and tape libraries, LAN switches (Layer 2 and Layer 3), desktop computer and notebooks.
• Perform installation, setup, and configuration of server and desktop operating systems, such as Microsoft Windows Server 2016, 2019 and newer, Microsoft Windows 10 and newer, Linux (Red Hat Enterprise Server, SUSE Linux Enterprise Server), standard applications on desktops such as Microsoft Office 365, email clients, antivirus clients, encryption etc.
• Upgrade hardware components such as hard disks, memory, I/O adapters in servers and storage systems.
• Upgrade Operating Systems and install patches and troubleshooting of OS.
• Perform installation, setup, and configuration of data backup / restore solutions such as Symantec Backup Exec / NetBackup, and able to provide advice to customers on backup policies.
• Remote operation of Data centre
• Knowledge of LAN, WAN, IP segments, basic installation of Firewall, L3/L2 switches, router etc will be added advantage
• To find out and understand the detail requirements of configuration settings from customers before installation and configuration starts.
• To coordinate and manage the progress of the installation and implementation of projects.

• Scheduling of telephone interviews
• Scheduling of complex interview loops often involving up to seven participants in multiple time zones
• Updating in-house recruiting systems
• Liaising with candidates
• Attending management meetings

Requirements:

• Strong knowledge of Microsoft office
• Prior experience of working on high volume recruiting campaigns
• Strong team player
• Above all else, you must be highly organized and possess excellent customer service skills.
• You must be a Problem Solver and able to partner with businesses to arrive at solutions
• Obsessive attention to detail
• Diploma in HR, Business Management, or similar
• Several years prior experience of working in an HR or recruiting function in an administration or coordination capacity
• Extensive experience using Applicant Tracking Systems
• Experience in supporting full life-cycle recruiting function within a corporate or recruitment agency environment
• Previous experience in a complex matrix organization
• Technology industry experience

About the client :

Asia’s largest global sports media property in history with a global broadcast to 150+ countries. As the world’s largest martial arts organization, they are a celebration of Asia’s greatest cultural treasure, and its deep-rooted Asian values of integrity, humility, honor, respect, courage, discipline, and compassion. Has achieved some of the highest TV ratings and social media engagement metrics across Asia with its unique brand of Asian values, world-class athletes, and world-class production. Broadcast partners include Turner Sports, Star India, TV Tokyo, Fox Sports, ABS-CBN, Astro, ClaroSports, Bandsports, Startimes, Premier Sports, Thairath TV, Skynet, Mediacorp, OSN, and more. Institutional investors include Sequoia Capital, Temasek Holdings, GIC, Iconiq Capital, Greenoaks Capital, and Mission Holdings. Currently has offices in Singapore, Tokyo, Los Angeles, Shanghai, Milan, Beijing, Bangkok, Manila, Jakarta, and Bangalore.

Position : Devops Engineer – SDE3

As part of the engineering team, you would be expected to have deep technology expertise with a passion for building highly scalable products. This is a unique opportunity where you can impact the lives of people across 150+ countries!

Responsibilities

• Develop Collaborate in large-scale systems design discussions.

• Deploying and maintaining in-house/customer systems ensuring high availability, performance and optimal cost.

• Automate build pipelines. Ensuring right architecture for CI/CD

• Work with engineering leaders to ensure cloud security

• Develop standard operating procedures for various facets of Infrastructure services (CI/CD, Git Branching, SAST, Quality gates, Auto Scaling)

• Perform & automate regular backups of servers & databases. Ensure rollback and restore capabilities are Realtime and with zero-downtime.

• Lead the entire DevOps charter for ONE Championship. Mentor other DevOps engineers. Ensure industry standards are followed.

Requirements

• Overall 5+ years of experience in as DevOps Engineer/Site Reliability Engineer

• B.E/B.Tech in CS or equivalent streams from institute of repute

• Experience in Azure is a must. AWS experience is a plus

• Experience in Kubernetes, Docker, and containers

• Proficiency in developing and deploying fully automated environments using Puppet/Ansible and Terraform

• Experience with monitoring tools like Nagios/Icinga, Prometheus, AlertManager, Newrelic

• Good knowledge of source code control (git)

• Expertise in Continuous Integration and Continuous Deployment setup using Azure Pipeline or Jenkins

• Strong experience in programming languages. Python is preferred

• Experience in scripting and unit testing

• Basic knowledge of SQL & NoSQL databases

• Strong Linux fundamentals

• Experience in SonarQube, Locust & Browserstack is a plus