Cutshort logo
For Employers
Ganit Business Solutions logo
Data Engineer_Scala

Data Engineer_Scala at Ganit Business Solutions · Remote only · 4 - 7 years · ₹10L - ₹30L / yr · Bootstrapped · Remote only · Posted 19 May 2022

Ganit Business Solutions's logo

Data Engineer_Scala

Vijitha VS's profile picture
Posted by Vijitha VS
4 - 7 yrs
₹10L - ₹30L / yr
Remote only
Skills
skill iconScala
ETL
Informatica
Data Warehouse (DWH)
Big Data
Hadoop
Apache Hive
PySpark
Spark

Job Description:

We are looking for a Big Data Engineer who have worked across the entire ETL stack. Someone who has ingested data in a batch and live stream format, transformed large volumes of daily and built Data-warehouse to store the transformed data and has integrated different visualization dashboards and applications with the data stores.    The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

Responsibilities:

  • Develop, test, and implement data solutions based on functional / non-functional business requirements.
  • You would be required to code in Scala and PySpark daily on Cloud as well as on-prem infrastructure
  • Build Data Models to store the data in a most optimized manner
  • Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Implementing the ETL process and optimal data pipeline architecture
  • Monitoring performance and advising any necessary infrastructure changes.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Proactively identify potential production issues and recommend and implement solutions
  • Must be able to write quality code and build secure, highly available systems.
  • Create design documents that describe the functionality, capacity, architecture, and process.
  • Review peer-codes and pipelines before deploying to Production for optimization issues and code standards

Skill Sets:

  • Good understanding of optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
  • Proficient understanding of distributed computing principles
  • Experience in working with batch processing/ real-time systems using various open-source technologies like NoSQL, Spark, Pig, Hive, Apache Airflow.
  • Implemented complex projects dealing with the considerable data size (PB).
  • Optimization techniques (performance, scalability, monitoring, etc.)
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, etc.,
  • Knowledge of various ETL techniques and frameworks, such as Flume
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • Creation of DAGs for data engineering
  • Expert at Python /Scala programming, especially for data engineering/ ETL purposes

 

 

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ganit Business Solutions

Founded :
2017
Type :
Services
Size :
100-1000
Stage :
Bootstrapped

About

Ganit Inc. is in the business of enhancing the Decision Making Power (DMP) of businesses by offering solutions that lie at the crossroads of discovery-based artificial intelligence, hypothesis-based analytics, and the Internet of Things (IoT).


The company's offerings consist of a functioning product suite and a bespoke service offering as its solutions. The goal is to integrate these solutions into the core of their client's decision-making processes as seamlessly as possible. Customers in the FMCG/CPG, Retail, Logistics, Hospitality, Media, Insurance, and Banking sectors are served by Ganit's offices in both India and the United States. The company views data as a strategic resource that may assist other businesses in achieving growth in both their top and bottom lines of business. We build and implement AI and ML solutions that are purpose-built for certain sectors to increase decision velocity and decrease decision risk.

Read more

Connect with the team

Profile picture
Viswanath Subramanian
Profile picture
Priyanka Beria
Profile picture
Kavitha J

Company social profiles

linkedin

Similar jobs (10)

Wissen Technology
at Wissen Technology
4 recruiters
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹18L - ₹28L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
5 - 10 yrs
₹8L - ₹28L / yr
skill iconPython
PySpark
SQL

Job Description – Data Engineer

Role: Data Engineer

Experience: 9+ Years

Location: Bangalore / Hyderabad

Notice Period: Immediate to 15 Days

Interview Process: 1st Round – Virtual | 2nd Round – F2F

Mandatory Skills

  • Python
  • PySpark
  • SQL
  • Azure Data Engineering

Job Description

We are looking for an experienced Azure Data Engineer with 9+ years of experience and strong hands-on expertise in Python, PySpark, SQL, and Azure Data Engineering.

Key Responsibilities

  • Develop and maintain scalable data engineering solutions using Azure.
  • Build and optimize data processing pipelines using PySpark and Python.
  • Write complex SQL queries for data extraction and transformation.
  • Work with Azure data services and cloud-based data platforms.
  • Perform data processing, transformation, and integration.
  • Troubleshoot data pipeline and production issues.
  • Collaborate with technical and business teams to deliver data solutions.

Preferred: Immediate to 15 Days joiners.

Read more
MNC
Actively reviewing applications
MNC
Agency job
via VY SYSTEMS PRIVATE LIMITED by Akilandeswari Panneerselvam
Bengaluru (Bangalore)
4 - 12 yrs
₹6L - ₹20L / yr
skill iconJava
SCA
skill iconPython
Data engineering
databricks
+2 more


We are hiring for a Data Engineer & Java scala for a full-time opportunity in Bangalore.


Experience: 4–10 Years


Must-Have Skills:


Java / Scala / Python, Data Engineering, Databricks / Snowflake, and Cloud (AWS / Azure / GCP).


We are looking for strong software engineers with hands-on experience in data platform development, scalable backend programming, data integration, and cloud technologies.


Experience in Banking, Capital Markets, Market Risk, or Regulatory Reporting will be an added advantage.

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹7L - ₹18L / yr
skill iconPython
PySpark
SQL

🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨


Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!


🔹 Role: Senior Data Engineer

🔹 Experience: 7+ Years

🔹 Location: Bangalore

🔹 CTC: Up to 26 LPA

🔹 Notice Period: Immediate to 10 Days Preferred


💻 Mandatory Skills


✅ PySpark

✅ Oracle SQL / PL/SQL

✅ Data Modeling & Design / Modernization

✅ Python

✅ ETL

✅ Data Pipelines


⚙️ Good to Have / Ecosystem Skills


✅ Kafka

✅ Hadoop

✅ AWS / Azure / GCP

✅ Git

✅ JIRA


📌 Key Responsibilities


• Develop and maintain scalable data pipelines using PySpark

• Work extensively with Oracle SQL/PLSQL for data processing and transformation

• Design and implement data models and data architecture

• Work on data design and modernization initiatives

• Develop and optimize ETL processes and data pipelines

• Handle large volumes of data using PySpark and Python

• Work with technologies such as Kafka, Hadoop, and Cloud platforms

• Collaborate with cross-functional teams to deliver scalable data solutions

• Use Git and JIRA for version control and project tracking


📩 Interested candidates can share their updated CV along with:


Total Experience:

Relevant PySpark Experience:

Relevant Oracle SQL/PLSQL Experience:

Data Modeling Experience:

Current Location:

Notice Period:

Current CTC:

Expected CTC:


#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners

Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Akshay Patil
Posted by Akshay Patil
Bengaluru (Bangalore)
14 - 25 yrs
₹50L - ₹70L / yr
Data engineering
databricks
Apache Spark
PySpark
skill iconPython
+19 more

Job Title : Senior Data Engineer – Databricks

Experience : 14 to 20 Years

Location : HSR Layout, Bangalore

Work Mode : Hybrid – 3 Days WFO

Shift : 11:30 AM – 07:30 PM IST

Positions : 2

Notice Period : Immediate Joiners Only

Interview : 1 Technical Round + 2 Client Rounds


Role Overview :

We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.

The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.


Must-Have Skills :

  • 14 to 20 years of Data Engineering experience
  • Databricks & Apache Spark / PySpark
  • Python & SQL
  • AWS Cloud
  • Lakehouse Architecture
  • ETL / ELT & Distributed Data Processing
  • Batch & Streaming Pipelines
  • Data Pipeline Optimization & Data Modeling
  • CDC & Incremental Processing
  • Git, CI/CD & Testing
  • Data Quality, Monitoring & Observability
  • Technical Leadership & Stakeholder Management


Key Responsibilities :

  • Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
  • Own data products from design through production.
  • Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
  • Optimize pipelines for performance, scalability, reliability, and cost.
  • Design scalable data architectures and data models.
  • Implement data quality, monitoring, lineage, and CI/CD practices.
  • Lead technical discussions and mentor engineering teams.
  • Collaborate with business stakeholders, architects, product owners, and engineering teams.
  • Remain hands-on while providing technical leadership.


Ideal Candidate :

A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.

🔴 Super Urgent : Only Bangalore-based immediate joiners.

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 9 yrs
₹10L - ₹17L / yr
skill iconPython
PySpark
SQL
data engineer

role: data engineer

Python pyspark, SQL, data engineer

5+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
Cloud Sara Technologies
Actively reviewing applications
Pradeepa R
Posted by Pradeepa R
Remote only
7 - 7 yrs
₹30L - ₹30L / yr
databricks
Snowflake
Apache Spark
PySpark
AWS RDS
+4 more

SENIOR DATA ENGINEER – DATABRICKS & SNOWFLAKE

Experience: 7+ Years

Location: Remote

Employment Type: Full-Time

Budget: Up to ₹30 LPA

Time Zone: US Eastern Time (ET)

Shift: US ET Night Shift

Job Description

We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Snowflake, Apache Spark, and AWS to design, develop, and maintain scalable data engineering solutions.

The candidate will work on integrating data from multiple sources, building modern data pipelines, developing enterprise data models, and preparing data platforms for AI/ML applications.

Experience in healthcare, scientific data, or the histopathology domain will be an added advantage.

Key Responsibilities

  • Design, build, and maintain scalable data pipelines to acquire, integrate, and manage data from diverse sources such as laboratory systems, MES, clinical supply, quality systems, and external partners.
  • Develop and optimize data workflows for structured and unstructured data using Python, PySpark, R, SQL, Databricks, and Snowflake.
  • Design and maintain enterprise-level data models and data repositories.
  • Perform ETL development, data warehousing, database design, and data integration.
  • Ensure data quality, versioning, traceability, and consistency to support AI/ML readiness.
  • Collaborate with stakeholders and technical teams to translate business requirements into technical solutions.
  • Manage multiple projects while ensuring scalability, performance, and reliability.

Required Skills

  • 7+ years of experience in Data Engineering.
  • Strong hands-on experience with Databricks and Snowflake.
  • Excellent knowledge of Apache Spark / PySpark.
  • Strong experience with AWS cloud services and AWS RDS.
  • Experience with Oracle and Microsoft SQL Server (MSSQL).
  • Proficiency in Python, R, and SQL.
  • Strong understanding of ETL, Data Warehousing (DWH), data modeling, and database design.
  • Experience with dbt and cloud-based data architectures.
  • Knowledge of NoSQL and graph databases.
  • Strong analytical, problem-solving, and stakeholder-management skills.
  • Good English communication skills (B2 level or above).
  • Willingness to work in the US Eastern Time (ET) night shift.

Preferred / Good to Have

  • Experience in histopathology, healthcare, life sciences, or scientific data environments.
  • Knowledge of CDISC, HL7, FHIR, OMOP, DICOM, or other regulated data standards.
  • Experience handling high-dimensional data, including imaging and sensor data.
  • Familiarity with MLOps and machine learning model deployment workflows.
  • Knowledge of Manufacturing Execution Systems (MES) and Laboratory Information Management Systems (LIMS).
  • Exposure to knowledge graphs and ontology-driven architectures.

Education

Bachelor's degree in Engineering, Data Science, Life Sciences, Computer Science, or a related field. A master's degree is preferred.

Interested candidates can apply with their updated resumes.

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 9 yrs
₹9L - ₹15L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F -

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Read more
NeoGenCode Technologies Pvt Ltd
Bengaluru (Bangalore)
5 - 8 yrs
₹20L - ₹35L / yr
Data engineering
Google Cloud Platform (GCP)
Apache Spark
Google BigQuery
SQL
+8 more

Job Title : Senior Data Engineer – GCP & Apache Spark

Job Details :

  • Number of Positions : 3
  • Employment Type : Contract-to-Hire (C2H)
  • Experience Required : 5 to 8 Years
  • Location : Manyata Tech Park, Bengaluru
  • Work Mode : Hybrid – 3 Days in Office per Week
  • Preferred Notice Period : Immediate to 15–20 Days
  • Project Duration : Initially 6–8 months, with a strong possibility of extension for long-term projects
  • Relocation : Candidates from outside Bengaluru can apply if they are willing to relocate.


Role Overview :

We are looking for experienced Senior Data Engineers with strong expertise in Google Cloud Platform (GCP), Apache Spark, BigQuery, and SQL to design, develop, and maintain scalable data pipelines and distributed data processing solutions.

The ideal candidate should have hands-on experience with cloud-based data engineering, end-to-end pipeline architecture, system design, performance optimization, debugging, and CI/CD practices.


Mandatory skills :

Apache Spark (PySpark / Scala), SQL, GCP, BigQuery, GCP Dataproc, Data Pipelines, System Design, CI/CD, Debugging & Problem-Solving.


Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines using Apache Spark, PySpark, and/or Scala.
  • Build and optimize batch and distributed data processing workflows on GCP.
  • Work extensively with BigQuery for data transformation, validation, analytics, and query optimization.
  • Develop and maintain data workflows using GCP services, including Dataproc, BigQuery, and Cloud Storage.
  • Design end-to-end data pipeline architectures with a focus on scalability, reliability, and performance.
  • Write and optimize complex SQL queries for large-scale datasets.
  • Troubleshoot and resolve data processing issues, pipeline failures, and performance bottlenecks.
  • Implement CI/CD practices for data engineering workflows, testing, and deployments.
  • Monitor pipeline performance and identify opportunities for continuous improvement.
  • Collaborate with cross-functional teams to understand requirements and deliver reliable data solutions.
  • Participate in code reviews, testing, production deployments, and production support.


Mandatory Skills :

  • Strong hands-on experience with Apache Spark, including PySpark and/or Scala.
  • Strong SQL skills and experience working with large-scale datasets.
  • Hands-on experience with Google Cloud Platform (GCP).
  • Practical experience with BigQuery and data warehousing concepts.
  • Working knowledge of GCP Dataproc.
  • Strong understanding of data pipelines, end-to-end workflows, and system design.
  • Practical experience with CI/CD and deployment processes.
  • Excellent debugging, troubleshooting, and problem-solving skills.


Preferred Skills :

  • Experience with Apache Airflow, Google Cloud Composer, or similar orchestration tools.
  • Knowledge of Kafka or other streaming and messaging technologies.
  • Proficiency in Python for data engineering and automation.
  • Experience with Git-based development workflows.
  • Knowledge of Linux/Unix environments and shell scripting.
  • Familiarity with monitoring, logging, data quality, and governance practices.


Required Qualifications :

  • 5 to 8 years of experience in Data Engineering, Big Data Engineering, or a related field.
  • Proven experience developing and maintaining scalable data pipelines.
  • Strong understanding of distributed data processing and cloud-based data architecture.
  • Ability to troubleshoot complex technical issues and optimize pipeline performance.
  • Strong communication, collaboration, and ownership skills.


Interview Process :

Round 1 : AI-Based Interview

  • Candidates must complete the AI interview as soon as possible after receiving the invitation.

Round 2 : Virtual Interview Drive

  • Interviews are planned for the upcoming drive; exact dates will be communicated separately.

Round 3 : Online Client Interview

  • Shortlisted candidates will attend the online interview.
  • Candidates must be available throughout the day on the scheduled interview date.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos