11+ Apache Spark Jobs in Kochi (Cochin) | Apache Spark Job openings in Kochi (Cochin)

Job Summary:

Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management.

Core Responsibilities:

· Build and manage high-volume data pipelines using Spark/Databricks.

· Implement ELT frameworks using Azure Data Factory/Synapse Pipelines.

· Optimize large-scale datasets in Delta/Iceberg formats.

· Implement robust data quality, monitoring, and governance layers.

· Collaborate with Data Scientists, Analysts, and Business stakeholders.

Technical Stack:

· Big Data: Apache Spark, Kafka, Hive, Airflow, Hudi/Iceberg

· Cloud: Azure (Synapse, ADF, ADLS Gen2), Databricks, AWS (Glue/S3)

· Languages: Python, Scala, SQL

· Storage Formats: Delta Lake, Iceberg, Parquet, ORC

· CI/CD: Azure DevOps, Terraform (infra as code), Git

Senior Data Engineer (Apache Stack + Databricks/Synapse)

Share cv to

Thirega@ vysystems dot com - WhatsApp - 91Five0033Five2Three

Role Overview

We are looking for a Senior Marketing Analytics professional with strong experience in Marketing Mix Modeling (MMM), Attribution Modeling, and ROI analysis. The role involves working closely with marketing and business leadership to deliver actionable insights that optimize marketing spend and drive business growth.

Key Responsibilities

• Analyze large-scale marketing and customer datasets to deliver actionable business insights.
• Build and maintain Marketing Mix Models (MMM) to measure media effectiveness and optimize marketing investments.
• Design and implement attribution models (multi-touch, incrementality, lift analysis) to evaluate campaign performance.
• Perform ROI, CAC, ROAS, and funnel analysis across marketing channels.
• Write complex SQL queries to extract, combine, and analyze data from multiple sources.
• Use Python for statistical analysis, regression modeling, forecasting, and experimentation.
• Develop and publish Tableau dashboards and automated reports for leadership and stakeholders.
• Work with marketing platforms such as Google Analytics (GA4), Adobe Analytics, Salesforce Marketing Cloud, Marketo, or similar tools.
• Collaborate with cross-functional teams to define KPIs, reporting requirements, and analytics roadmaps.
• Present insights and recommendations clearly to senior leadership and non-technical stakeholders.
• Ensure data accuracy, consistency, and documentation of analytics methodologies.

Required Skills & Qualifications

• 8+ years of experience in analytics, with a strong focus on marketing or digital analytics.
• Hands-on expertise in Marketing Mix Modeling (MMM) and Attribution Modeling.
• Strong proficiency in SQL and Python for data analysis.
• Experience with Tableau for dashboarding and automated reporting.
• Working knowledge of Google Analytics / GA4, Adobe Analytics, and marketing automation or CRM tools.
• Strong understanding of data modeling, reporting, and ROI measurement.
• Excellent stakeholder management, communication, and data storytelling skills.
• Ability to work independently in a fast-paced and ambiguous environment.

Good to Have

• Experience with Power BI / Looker / BigQuery
• Exposure to A/B testing, experimentation, or econometric modeling
• Experience working with large marketing datasets and cloud platforms

Role Overview

We are looking for a Senior Marketing Analytics professional with strong experience in Marketing Mix Modeling (MMM), Attribution Modeling, and ROI analysis. The role involves working closely with marketing and business leadership to deliver actionable insights that optimize marketing spend and drive business growth.

Key Responsibilities

• Analyze large-scale marketing and customer datasets to deliver actionable business insights.
• Build and maintain Marketing Mix Models (MMM) to measure media effectiveness and optimize marketing investments.
• Design and implement attribution models (multi-touch, incrementality, lift analysis) to evaluate campaign performance.
• Perform ROI, CAC, ROAS, and funnel analysis across marketing channels.
• Write complex SQL queries to extract, combine, and analyze data from multiple sources.
• Use Python for statistical analysis, regression modeling, forecasting, and experimentation.
• Develop and publish Tableau dashboards and automated reports for leadership and stakeholders.
• Work with marketing platforms such as Google Analytics (GA4), Adobe Analytics, Salesforce Marketing Cloud, Marketo, or similar tools.
• Collaborate with cross-functional teams to define KPIs, reporting requirements, and analytics roadmaps.
• Present insights and recommendations clearly to senior leadership and non-technical stakeholders.
• Ensure data accuracy, consistency, and documentation of analytics methodologies.

Required Skills & Qualifications

• 8+ years of experience in analytics, with a strong focus on marketing or digital analytics.
• Hands-on expertise in Marketing Mix Modeling (MMM) and Attribution Modeling.
• Strong proficiency in SQL and Python for data analysis.
• Experience with Tableau for dashboarding and automated reporting.
• Working knowledge of Google Analytics / GA4, Adobe Analytics, and marketing automation or CRM tools.
• Strong understanding of data modeling, reporting, and ROI measurement.
• Excellent stakeholder management, communication, and data storytelling skills.
• Ability to work independently in a fast-paced and ambiguous environment.

Good to Have

• Experience with Power BI / Looker / BigQuery
• Exposure to A/B testing, experimentation, or econometric modeling
• Experience working with large marketing datasets and cloud platforms

Job Description:

1.Be a hands on problem solver with consultative approach, who can apply Machine Learning & Deep Learning algorithms to solve business challenges

a. Use the knowledge of wide variety of AI/ML techniques and algorithms to find what combinations of these techniques can best solve the problem

b. Improve Model accuracy to deliver greater business impact

c.Estimate business impact due to deployment of model

2.Work with the domain/customer teams to understand business context , data dictionaries and apply relevant Deep Learning solution for the given business challenge

3.Working with tools and scripts for sufficiently pre-processing the data & feature engineering for model development – Python / R / SQL / Cloud data pipelines

4.Design , develop & deploy Deep learning models using Tensorflow / Pytorch 

5.Experience in using Deep learning models with text, speech, image and video data

a.Design & Develop NLP models for Text Classification, Custom Entity Recognition, Relationship extraction, Text Summarization, Topic Modeling, Reasoning over Knowledge Graphs, Semantic Search using NLP tools like Spacy and opensource Tensorflow, Pytorch, etc

b.Design and develop Image recognition & video analysis models using Deep learning algorithms and open source tools like OpenCV

c.Knowledge of State of the art Deep learning algorithms

6.Optimize and tune Deep Learnings model for best possible accuracy

7.Use visualization tools/modules to be able to explore and analyze outcomes & for Model validation eg: using Power BI / Tableau

8.Work with application teams, in deploying models on cloud as a service or on-prem

a.Deployment of models in Test / Control framework for tracking

b.Build CI/CD pipelines for ML model deployment

9.Integrating AI&ML models with other applications using REST APIs and other connector technologies

10.Constantly upskill and update with the latest techniques and best practices. Write white papers and create demonstrable assets to summarize the AIML work and its impact.

· Technology/Subject Matter Expertise

• Sufficient expertise in machine learning, mathematical and statistical sciences
• Use of versioning & Collaborative tools like Git / Github
• Good understanding of landscape of AI solutions – cloud, GPU based compute, data security and privacy, API gateways, microservices based architecture, big data ingestion, storage and processing, CUDA Programming
• Develop prototype level ideas into a solution that can scale to industrial grade strength
• Ability to quantify & estimate the impact of ML models.

· Softskills Profile

• Curiosity to think in fresh and unique ways with the intent of breaking new ground.
• Must have the ability to share, explain and “sell” their thoughts, processes, ideas and opinions, even outside their own span of control
• Ability to think ahead, and anticipate the needs for solving the problem will be important

·        Ability to communicate key messages effectively, and articulate strong opinions in large forums

· Desirable Experience:

• Keen contributor to open source communities, and communities like Kaggle
• Ability to process Huge amount of Data using Pyspark/Hadoop
• Development & Application of Reinforcement Learning
• Knowledge of Optimization/Genetic Algorithms
• Operationalizing Deep learning model for a customer and understanding nuances of scaling such models in real scenarios
• Optimize and tune deep learning model for best possible accuracy
• Understanding of stream data processing, RPA, edge computing, AR/VR etc
• Appreciation of digital ethics, data privacy will be important
• Experience of working with AI & Cognitive services platforms like Azure ML, IBM Watson, AWS Sagemaker, Google Cloud will all be a big plus
• Experience in platforms like Data robot, Cognitive scale, H2O.AI etc will all be a big plus

Roles and Responsibilities

• Plan, architect, integrate, and develop back-end and database driven features using the Python language and frameworks (Django, Flask, Tornado)

• Experience on Micro service architecture

• Strong knowledge on Web services/API

• Strong Knowledge on AWS/Azure, Docker, etc..

• Having great knowledge on software development methodologies, languages, technologies, security threats, etc.

• Create decoupled, interactive web UIs using JavaScript (Angular, Ember, jQuery, React Js)

• Provide technical advise and recommendations for language and software choices

• Develop code that is cross-browser and cross-platform friendly

• Collaborate with project stakeholders to ensure all requirements are met

• Evaluate technologies and manage technical planning

• Support and ongoing development for existing projects

• Provide clean code and proper documentation for each project

• Assists in resolving moderately complex production support problems

• Strong writing and speaking skills (English)

Technical Requirements:

• At least 4+ years experience developing and deploying websites and applications

• Experience with Django

• Experience with Agile/SCRUM practices

• Hands on experience on database like PostgreSQL,MySQL, Mongo db, etc.

• Custom web based application development experience

• Comfortable collaborating with designers, front-end developers and other team members

• Object-oriented design and development strategies

Responsibilities:

• Writing clean, high-quality, high-performance, maintainable code
• Develop and support software including applications, database integration, interfaces, and new functionality enhancements
• Responsible for the product development and maintenance
• Analyze and resolve performance bottlenecks

Requirements:

• A  self-motivated, multi-tasker, and demonstrated team-player.
• 3+ Years of experience in Web Application Development
• Should excel in working with large-scale applications and frameworks

• Expert in Programming using Angular 8/10/11, Web API
• Should have knowledge in Relational and Non-Relational databases (NO SQL).
• Strong knowledge of SDLC methodologies – Agile/Scrum
• Very good development skills in front end technologies/javascript libraries like angular etc.
• Good understanding of Object-Oriented Programming, Design Concepts & Unit Testing
• Good understanding of Web Security Concepts

• HTML/CSS/ES6 Javascript, Java 8 and any Java based web framework
• Adobe experience Manager (AEM) Apache Sling, JCR, OSGI
• Good knowledge in Apache Sling framework
• Good knowledge in Java content repository API
• Good knowledge in Apache Jack rabbbit framework
• Knowledge of OSGI and Declarative Services
• Strong understanding of REST Principles and Hands on experience REST based API  development
•  Knowledge of Patterns and good practices to design and develop quality and clean code
• Experience in Pair programming and code reviews
• Experience with testing at all levels unit, integration, functional and performance
• Experience in Agile Project (Scrum or SAFe) execution is a must
• Familiarity with git, basic git branching strategies, working in a peer-reviewed  environment,able to code to existing patterns/styles
• Familiarity with task management, bug tracking and wiki-based documentation tools like Jiraand confluence

• AEM BE developers must have modern ES6 javascript experience as well as java developer experience
• Must be comfortable working with AEM workflows, scheduled jobs, creating/modifying jcr
• nodes via java code, and accessing REST endpoints via java code
• Ability to create custom AEM CQ components and a good exposure to both core and
•  foundation components that can be inherited in AEM
• Good understanding of AEM web development framework using Apache Sling
• Create multiple OSGI Bundles in the AEM stack based on the requirements of the Project

Roles & Responsibilities:

1. ·Manage company’s various online bidding profiles
2. ·Identifying quality lead and bringing up the projects for the company
3. ·Bidding on various portals like PPH/ GURU/ UPWORK / Freelancer and other relevant online platforms
4. · Handle the initial discussions and collect the strategic information about the prospects
5. ·Understand complex project requirements and prepare proposal /bid to generate leads
6. ·Continue prospect engagement and account management throughout the sales cycle until closure.
7. ·Independently collaborate with the technical team for presentation with prospects.
8. · Scout for new bidding platforms and websites to catch out the opportunities.
9. Skill & Experience Required
10. ·       Excellent verbal and written communication skills, capable of converting the prospect with good linguistic ability.
11. ·       Must have 1-3 years of experience in Web Development & Mobile Apps project acquisition and closure through the online bidding platforms.
12. ·       Experience with lead generation and prospect management via various online bidding platforms.
13. ·       Must have sound technical knowledge of advanced Web and Mobile technologies trending today.
14. ·       Lead generation through LinkedIn, database, and other social networks would be an added value.
15. ·       Ability to handle the sales independently or as part of a team.
16. Education: Degree/ any diploma

Experience: 1- 3 years

Salary: negotiable

.

•  DOT NETCore,.NET, C#,NET Core, http://asp.net/" target="_blank">ASP.NET Core Rest API, Odata,
• Blazor, HTML, CSS, Bootstrap, JavaScript,
• Development of Docker container-based microservices,
• Azure SaaS Services (Azure Service Bus, Azure Kubernetes Services, CosmosDB, Cognitive Services, Redis),
• Azure DevOps (ALM Platform),
• CI/CD delivery via Azure Pipelines,
• MS-SQL (T-SQL) and No-SQL databases (MongoDB),
• Object-Oriented Programming Principles, SOLID, Design patterns
• Good communication skill

We are looking for a seasoned frontend developer to join our product team. This role requires you to be a tech-savvy contributor in translating the customer needs and user expectation into interactive web apps. You’ll be an exceptional problem solver and take responsible actions in ensuring the application is optimized both in technology and in delivering best user experience.

Responsibilities:

• Work closely with design, product management and development teams to create elegant, usable, responsive and interactive interfaces across multiple devices.
• Turning UI/UX designs into prototypes, creating awesome interactions from designs, writing reusable content modules and maintainability of the code.
• Implement UI development principles to ensure that the product client-side serves at scale.
• Review and optimize the app usage by monitoring key metrics and rectifying the issues proactively.
• An ability to perform well in a fast-paced environment and bring in optimal flow for rapidly changing design/ technology.

Requirements:

• 2 to 5 years of relevant work experience as a web developer, UI developer, JavaScript expert or frontend engineer
• Experience in Frontend Technologies 
  • Typescript - the right way. Ie, not using it exactly like Javascript, instead using it in the way it was intended to be used.
  • React
  • GraphQL (Relay Specification is a plus)
  • Apollo Client for React OR React-Relay
• Worked in large React Projects preferably in TypeScript, with proper usage of Typing.
  • Familar with React Contexts and Hooks
  • Should have a very good understanding, and practical knowledge in Advanced Guides in React (https://reactjs.org/docs/forwarding-refs.html" target="_blank">https://reactjs.org/docs/forwarding-refs.html) 
• Familiar with UI layouts, SASS, bootstrap and the CSS GRID system
• Experience with a GraphQL backend using either Apollo Client for React or React Relay is a plus
• Experience using any one React UI Framework: Ant UI, Elastic UI, Material Framework for React, Blueprint UI or Bootstrap for React

Daily monitoring of Quantum's processes to ensure file transmissions to and from the system

• Ensure that any Quantum production issues with an emphasis on the modules ( Cash Management, Bank Reconciliation, Foreign Exchange, I/C loans, Money Market, Investments, etc.) are resolved on time
• Actively working with Quantum and internal IT teams to resolve issues with bank files and data transmissions between Quantum and other systems including retrieval of market rates