Data Scientist

Hiring: GCP Data Engineer (FTE)

📍 Location: Bangalore | Chennai | Pune | Gurgaon | Kolkata

💼 Employment Type: Full-Time

Notice Period - Immediate Joiner ( Serving Notice Period )

Work Mode - Hybrid

We are looking for experienced GCP Data Engineers with strong expertise in building scalable cloud data solutions.

Required Skills:

✔ GCP Data Engineering Experience

✔ BigQuery

✔ SQL & Python

✔ PySpark / Apache Spark

✔ Apache Beam / Dataflow

✔ ETL / ELT Pipeline Development

✔ Airflow / Cloud Composer

Responsibilities:

• Design and develop scalable ETL/ELT pipelines on GCP
• Build and optimize BigQuery solutions
• Process large-scale structured/unstructured data using Spark
• Develop automated workflows and cloud-native data pipelines
• Work with GCP services like Dataflow, Dataproc, Cloud Storage, etc.
• 
  

Good to Have:

• Google Cloud Certifications (Professional Data Engineer / Solution Architect)
• Experience with BigTable, Cloud SQL, Spanner, NoSQL databases

🎓 Qualification: Bachelor’s / Master’s in CS, Engineering, or related field

Review Criteria:

Mandatory:

• Strong AI Runtime Engineering (Lead / Staff) Profiles
• Must have 4+ years of software engineering experience
• Must have proven 1+ years of experience designing, building, and owning AI runtime infrastructure supporting distributed training and/or inference at scale
• Must have hands-on experience optimizing deep learning runtimes such as PyTorch, TensorFlow, etc
• Must have strong low-level performance engineering experience, including profiling, debugging, and optimizing system throughput, latency, and reliability
• Must have experience leading or mentoring a team, including technical guidance, code reviews, and delivery ownership
• Must have strong programming skills in Python, Java, C++ , etc

Preferred:

Experience with Kubernetes, Ray, TorchElastic, or custom AI job orchestration frameworks

Exposure to LLM training pipelines, checkpointing, elastic or distributed training orchestration

Role & Responsibilities:

As Lead/Staff AI Runtime Engineer, you’ll play a pivotal role in the design, development, and optimization of the core runtime infrastructure that powers distributed training and deployment of large AI models (LLMs and beyond). This is a hands-on leadership role - perfect for a systems-minded software engineer who thrives at the intersection of AI workloads, runtimes, and performance-critical infrastructure. You’ll own critical components of our PyTorch-based stack, lead technical direction, and collaborate across engineering, research, and product to push the boundaries of elastic, fault-tolerant, high-performance model execution.

What you’ll do:

Lead Runtime Design & Development:

• Own the core runtime architecture supporting AI training and inference at scale.
• Design resilient and elastic runtime features (e.g. dynamic node scaling, job recovery) within our custom PyTorch stack.
• Optimize distributed training reliability, orchestration, and job-level fault tolerance.

Drive Performance at Scale:

• Profile and enhance low-level system performance across training and inference pipelines.
• Improve packaging, deployment, and integration of customer models in production environments.
• Ensure consistent throughput, latency, and reliability metrics across multi-node, multi- GPU setups.

Build Internal Tooling & Frameworks:

• Design and maintain libraries and services that support model lifecycle: training, check pointing, fault recovery, packaging, and deployment.
• Implement observability hooks, diagnostics, and resilience mechanisms for deep learning workloads.
• Champion best practices in CI/CD, testing, and software quality across the AI Runtime stack.

Collaborate & Mentor:

• Work cross-functionally with Research, Infrastructure, and Product teams to align runtime development with customer and platform needs.
• Guide technical discussions, mentor junior engineers, and help scale the AI Runtime team’s capabilities.

Ideal Candidate:

• 5+ years of experience in systems/software engineering, with deep exposure to AI runtime, distributed systems, or compiler/runtime interaction.
• Experience in delivering PaaS services.
• Proven experience optimizing and scaling deep learning runtimes (e.g. PyTorch, TensorFlow, JAX) for large-scale training and/or inference.
• Strong programming skills in Python and C++ (Go or Rust is a plus).
• Familiarity with distributed training frameworks, low-level performance tuning, and resource orchestration.
• Experience working with multi-GPU, multi-node, or cloud-native AI workloads.
• Solid understanding of containerized workloads, job scheduling, and failure recovery inproduction environments.

Technical Trainer – HTML, CSS, C & Python

We are looking for a dedicated and experienced Technical Trainer to deliver engaging and effective training sessions on HTML, CSS, C programming, and Python. The trainer will be responsible for designing the curriculum, preparing hands-on labs, and conducting in-person or online sessions for students or professionals. You will play a key role in helping learners understand core programming concepts, web development, and coding best practices through interactive teaching methods.

The ideal candidate should have strong technical expertise, a passion for teaching, and the ability to explain complex topics in a clear, simple manner.

As an employee of our company, you will collaborate with each department to create and deploy disruptive products. Come work at a growing company that offers great benefits with opportunities to move forward and learn alongside accomplished leaders. We're seeking an experienced and outstanding member of staff.

This position is both creative and rigorous by nature you need to think outside the box. We expect the candidate to be proactive and have a "get it done" spirit. To be successful, you will have solid solving problem skills.

Responsibilities

• Design & Develop Odoo Apps
• Translate requirements into clean and efficient code
• Analyze, diagnose and resolve errors relate to the applications.

Must Have

• Bachelor's Degree In Computers/MCA
• Object-oriented programming language
• Basics of Python/HTML/CSS/JS
• Highly creative and autonomous

Nice To Have

• Python/Javascript Knowledge
• Linux, Github
• Contribution in open source projects
• Strong communication skills

What's great in the job?

• Great team of smart people, in a friendly and open culture
• No dumb managers, no stupid tools to use, no rigid working hours
• No waste of time in enterprise processes, real responsibilities and autonomy
• Expand your knowledge of various business industries
• Create content that will help our users on a daily basis
• Real responsibilities and challenges in a fast evolving company

What You Will Do :

As a Data Governance Lead at Kanerika, you will be responsible for defining, leading, and operationalizing the data governance framework, ensuring enterprise-wide alignment and regulatory compliance.

Required Qualifications :

- 7+ years of experience in data governance and data management.

- Proficient in Microsoft Purview and Informatica data governance tools.

- Strong in metadata management, lineage mapping, classification, and security.

- Experience with ADF, REST APIs, Talend, dbt, and automation via Azure tools.

- Knowledge of GDPR, CCPA, HIPAA, SOX and related compliance needs.

- Skilled in bridging technical governance with business and compliance goals.

Tools & Technologies :

- Microsoft Purview, Collibra, Atlan, Informatica Axon, IBM IG Catalog

- Microsoft Purview capabilities :

1. Label creation & policy setup

2. Auto-labeling & DLP

3. Compliance Manager, Insider Risk, Records & Lifecycle Management

4. Unified Catalog, eDiscovery, Data Map, Audit, Compliance alerts, DSPM.

Key Responsibilities :

1. Governance Strategy & Stakeholder Alignment :

- Develop and maintain enterprise data governance strategies, policies, and standards.

- Align governance with business goals : compliance, analytics, and decision-making.

- Collaborate across business, IT, legal, and compliance teams for role alignment.

- Drive governance training, awareness, and change management programs.

2. Microsoft Purview Administration & Implementation :

- Manage Microsoft Purview accounts, collections, and RBAC aligned to org structure.

- Optimize Purview setup for large-scale environments (50TB+).

- Integrate with Azure Data Lake, Synapse, SQL DB, Power BI, Snowflake.

- Schedule scans, set classification jobs, and maintain collection hierarchies.

3. Metadata & Lineage Management :

- Design metadata repositories and maintain business glossaries and data dictionaries.

- Implement ingestion workflows via ADF, REST APIs, PowerShell, Azure Functions.

- Ensure lineage mapping (ADF ? Synapse ? Power BI) and impact analysis.

4. Data Classification & Security Governance :

- Define classification rules and sensitivity labels (PII, PCI, PHI).

- Integrate with MIP, DLP, Insider Risk Management, and Compliance Manager.

- Enforce records management, lifecycle policies, and information barriers.

5. Data Quality & Policy Management :

- Define KPIs and dashboards to monitor data quality across domains.

- Collaborate on rule design, remediation workflows, and exception handling.

- Ensure policy compliance (GDPR, HIPAA, CCPA, etc.) and risk management.

6. Business Glossary & Stewardship :

- Maintain business glossary with domain owners and stewards in Purview.

- Enforce approval workflows, standard naming, and steward responsibilities.

- Conduct metadata audits for glossary and asset documentation quality.

7. Automation & Integration :

- Automate governance processes using PowerShell, Azure Functions, Logic Apps.

- Create pipelines for ingestion, lineage, glossary updates, tagging.

- Integrate with Power BI, Azure Monitor, Synapse Link, Collibra, BigID, etc.

8. Monitoring, Auditing & Compliance :

- Set up dashboards for audit logs, compliance reporting, metadata coverage.

- Oversee data lifecycle management across its phases.

- Support internal and external audit readiness with proper documentation.

Proficient in Golang, Python, Java, C++, or Ruby (at least one)

Strong grasp of system design, data structures, and algorithms

Experience with RESTful APIs, relational and NoSQL databases

Proven ability to mentor developers and drive quality delivery

Track record of building high-performance, scalable systems

Excellent communication and problem-solving skills

Experience in consulting or contractor roles is a plus

• Work towards improving the following 4 verticals - scalability, availability, security, and cost, for company's workflows and products.
• Help in provisioning, managing, optimizing cloud infrastructure in AWS (IAM, EC2, RDS, CloudFront, S3, ECS, Lambda, ELK etc.)
• Work with the development teams to design scalable, robust systems using cloud architecture for both 0-to-1 and 1-to-100 products.
• Drive technical initiatives and architectural service improvements.
• Be able to predict problems and implement solutions that detect and prevent outages.
• Mentor/manage a team of engineers.
• Design solutions with failure scenarios in mind to ensure reliability.
• Document rigorously to keep track of all changes/upgrades to the infrastructure and as well share knowledge with the rest of the team
• Identify vulnerabilities during development with actionable information to empower developers to remediate vulnerabilities
• Automate the build and testing processes to consistently integrate code
• Manage changes to documents, software, images, large web sites, and other collections of code, configuration, and metadata among disparate teams