Cutshort logo
Ganit Business Solutions logo
Data Engineer_Scala
Ganit Business Solutions's logo

Data Engineer_Scala

Vijitha VS's profile picture
Posted by Vijitha VS
4 - 7 yrs
₹10L - ₹30L / yr
Remote only
Skills
skill iconScala
ETL
Informatica
Data Warehouse (DWH)
Big Data
Hadoop
Apache Hive
PySpark
Spark

Job Description:

We are looking for a Big Data Engineer who have worked across the entire ETL stack. Someone who has ingested data in a batch and live stream format, transformed large volumes of daily and built Data-warehouse to store the transformed data and has integrated different visualization dashboards and applications with the data stores.    The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

Responsibilities:

  • Develop, test, and implement data solutions based on functional / non-functional business requirements.
  • You would be required to code in Scala and PySpark daily on Cloud as well as on-prem infrastructure
  • Build Data Models to store the data in a most optimized manner
  • Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Implementing the ETL process and optimal data pipeline architecture
  • Monitoring performance and advising any necessary infrastructure changes.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data and analytics experts to strive for greater functionality in our data systems.
  • Proactively identify potential production issues and recommend and implement solutions
  • Must be able to write quality code and build secure, highly available systems.
  • Create design documents that describe the functionality, capacity, architecture, and process.
  • Review peer-codes and pipelines before deploying to Production for optimization issues and code standards

Skill Sets:

  • Good understanding of optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
  • Proficient understanding of distributed computing principles
  • Experience in working with batch processing/ real-time systems using various open-source technologies like NoSQL, Spark, Pig, Hive, Apache Airflow.
  • Implemented complex projects dealing with the considerable data size (PB).
  • Optimization techniques (performance, scalability, monitoring, etc.)
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, etc.,
  • Knowledge of various ETL techniques and frameworks, such as Flume
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • Creation of DAGs for data engineering
  • Expert at Python /Scala programming, especially for data engineering/ ETL purposes

 

 

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ganit Business Solutions

Founded :
2017
Type :
Products & Services
Size :
100-1000
Stage :
Bootstrapped

About

Ganit Inc. is in the business of enhancing the Decision Making Power (DMP) of businesses by offering solutions that lie at the crossroads of discovery-based artificial intelligence, hypothesis-based analytics, and the Internet of Things (IoT).


The company's offerings consist of a functioning product suite and a bespoke service offering as its solutions. The goal is to integrate these solutions into the core of their client's decision-making processes as seamlessly as possible. Customers in the FMCG/CPG, Retail, Logistics, Hospitality, Media, Insurance, and Banking sectors are served by Ganit's offices in both India and the United States. The company views data as a strategic resource that may assist other businesses in achieving growth in both their top and bottom lines of business. We build and implement AI and ML solutions that are purpose-built for certain sectors to increase decision velocity and decrease decision risk.

Read more

Connect with the team

Profile picture
Viswanath Subramanian
Profile picture
Priyanka Beria
Profile picture
Kavitha J

Company social profiles

N/A

Similar jobs

Gandhinagar
0 - 2 yrs
₹1L - ₹2.5L / yr
NumPy
pandas
matplotlib
Audio

Job Title: (Generative AI Engineer Specialist in Deep Learning)


Location: Gandhinagar, Ahmedabad, Gujarat

Company: Rayvat Outsourcing

Salary: Upto 2,50,000/- per annum


Job Type: Full-Time


Experience: 0 to 1 Year


Job Overview:


We are seeking a talented and enthusiastic Generative AI Engineer to join our team. As an Intermediate-level engineer, you will be responsible for developing and deploying state-of-the-art generative AI models to solve complex problems and create innovative solutions. You will collaborate with cross-functional teams, working on a variety of projects that range from natural language processing (NLP) to image generation and multimodal AI systems. The ideal candidate has hands-on experience with machine learning models, deep learning techniques, and a passion for artificial intelligence.


Key Responsibilities:


·        Develop, fine-tune, and deploy generative AI models using frameworks such as GPT, BERT, DALL·E, Stable Diffusion, etc.

·        Research and implement cutting-edge machine learning algorithms in NLP, computer vision, and multimodal systems.

·        Collaborate with data scientists, ML engineers, and product teams to integrate AI solutions into products and platforms.

·        Create APIs and pipelines to deploy models in production environments, ensuring scalability and performance.

·        Analyze large datasets to identify key features, patterns, and use cases for model training.

·        Debug and improve existing models by evaluating performance metrics and applying optimization techniques.

·        Stay up-to-date with the latest advancements in AI, deep learning, and generative models to continually enhance the solutions.

·        Document technical workflows, including model architecture, training processes, and performance reports.

·        Ensure ethical use of AI, adhering to guidelines around AI fairness, transparency, and privacy.


Qualifications:


·        Bachelor’s/Master’s degree in Computer Science, Machine Learning, Data Science, or a related field.

·        2-4 years of hands-on experience in machine learning and AI development, particularly in generative AI.

·        Proficiency with deep learning frameworks such as TensorFlow, PyTorch, or similar.

·        Experience with NLP models (e.g., GPT, BERT) or image-generation models (e.g., GANs, diffusion models).

·        Strong knowledge of Python and libraries like NumPy, Pandas, scikit-learn, etc.

·        Experience with cloud platforms (e.g., AWS, GCP, Azure) for AI model deployment and scaling.

·        Familiarity with APIs, RESTful services, and microservice architectures.

·        Strong problem-solving skills and the ability to troubleshoot and optimize AI models.

·        Good understanding of data preprocessing, feature engineering, and handling large datasets.

·        Excellent written and verbal communication skills, with the ability to explain complex concepts clearly.


Preferred Skills:


·        Experience with multimodal AI systems (combining text, image, and/or audio data).

·        Familiarity with ML Ops and CI/CD pipelines for deploying machine learning models.

·        Experience in A/B testing and performance monitoring of AI models in production.

·        Knowledge of ethical AI principles and AI governance.


What We Offer:


·        Competitive salary and benefits package.

·        Opportunities for professional development and growth in the rapidly evolving AI field.

·        Collaborative and dynamic work environment, with access to cutting-edge AI technologies.

·        Work on impactful projects with real-world applications.

Read more
Kitty Technologies Pvt Ltd
kitty Technologies
Posted by kitty Technologies
Nagercoil
0 - 1 yrs
₹1L - ₹2L / yr
Social Media Marketing (SMM)
Search Engine Optimization (SEO)

Job Title: E-Commerce Executive


Salary: ₹16,000 - ₹25,000 per month

Experience: Minimum 1 year in e-commerce


Job Description:

We are seeking a motivated and detail-oriented E-Commerce Executive to join our dynamic team. The ideal candidate will have a solid understanding of e-commerce platforms, particularly Amazon, and will be responsible for managing and optimizing our online sales channels.


Key Responsibilities:

- Manage and optimize product listings on Amazon and other e-commerce platforms.

- Monitor inventory levels and coordinate with suppliers to ensure timely stock replenishment.

- Analyze sales data and market trends to identify opportunities for growth.

- Implement marketing strategies to enhance product visibility and drive sales.

- Handle customer inquiries and resolve issues related to online orders.

- Collaborate with the marketing team to create promotional campaigns.

- Stay updated on e-commerce trends and best practices.


Qualifications:

- Minimum 1 year of experience in e-commerce management.

- Knowledge of Amazon Seller Central and other e-commerce platforms.

- Strong analytical skills and attention to detail.

- Excellent communication and interpersonal skills.

- Ability to work independently and as part of a team.

- Proficiency in Microsoft Office and e-commerce management tools.


Read more
Prayagraj
2 - 3 yrs
₹2.4L - ₹4.8L / yr
Communication Skills
Soft skills
English speaking
business communication
Training and Development

Company Description


Nadcab Labs is a dynamic and innovative team of blockchain enthusiasts based in Prayagraj. Our primary focus is on developing cutting-edge applications for the decentralized world, including smart contracts, decentralized applications (Dapp's), and various DeFi (Decentralized Finance) products. We are dedicated to building robust and secure blockchain solutions.


Role & Responsibilities


  • Be expert in the English language (grammar, vocabulary, and training methodology) and Business Communication.
  • Have an error-free verbal fluency in speaking and writing English.
  • Conduct daily training sessions with employees
  • Include soft-skills and behavioral training (according to in-house observation of employees).
  • Identify individual areas of improvement and help employees with them via periodical 1-on-1 meetings.
  • Coordinate with management to better customize training modules and sessions.
  • ·Create engaging training material.
  • ·Promote a global communication culture with language and soft skills.


Qualifications


  • 2Years of experience with English language and soft-skills training.
  • Knowledge of the global standards of English and Business Communication.
  • Research skills required to carry out diagnostic check-ups for communication hurdles within the firm.
  • Periodical tests ready for the various stages of training.


Read more
T500
T500
Agency job
via Talent500 by ANSR by Raghu R
Bengaluru (Bangalore)
3 - 9 yrs
₹10L - ₹30L / yr
Informatica MDM
Data modeling
IDQ

Primary Duties and Responsibilities 

  • Experience with Informatica Multidomain MDM 10.4 tool suite preferred
  • Partnering with data architects and engineers to ensure an optimal data model design and implementation for each MDM domain in accordance with industry and MDM best practices
  • Works with data governance and business steward(s) to design, develop, and configure business rules for data validation, standardize, match, and merge
  • Implementation of Data Quality policies, procedures and standards along with Data Governance Team for maintenance of customer, location, product, and other data domains; Experience with Informatica IDQ tool suite preferred.
  • Performs data analysis and source-to-target mapping for ingest and egress of data.
  • Maintain compliance with change control, SDLC, and development standards.
  • Champion the creation and contribution to technical documentation and diagrams.
  • Establishes a technical vision and strategy with the team and works with the team to turn it into reality.
  • Emphasis on coaching and training to cultivate skill development of team members within the department.
  • Responsible for keeping up with industry best practices and trends.
  • Monitor, troubleshoot, maintain, and continuously improve the MDM ecosystem.

Secondary Duties and Responsibilities

  • May participate in off-hours on-call rotation.
  • Attends and is prepared to participate in team, department and company meetings.
  • Performs other job related duties and special projects as assigned.

Supervisory Responsibilities

This is a non-management role

Education and Experience

  • Bachelor's degree in MIS, Computer Sciences, Business Administration, or related field; or High School Degree/General Education Diploma and 4 years of relevant experience in lieu of Bachelor's degree.
  • 5+ years of experience in implementing MDM solutions using Informatica MDM.
  • 2+ years of experience in data stewardship, data governance, and data management concepts.
  • Professional working knowledge of Customer 360 solution
  • Professional working knowledge in multi domain MDM data modeling.
  • Strong understanding of company master data sets and their application in complex business processes and support data profiling, extraction, and cleansing activities using Informatica Data Quality (IDQ).
  • Strong knowledge in the installation and configuration of the Informatica MDM Hub.
  • Familiarity with real-time, near real-time and batch data integration.
  • Strong experience and understanding of Informatica toolsets including Informatica MDM Hub, Informatica Data Quality (IDQ), Informatica Customer 360, Informatica EDC, Hierarchy Manager (HM), Business Entity Service Model, Address Doctor, Customizations & Composite Services
  • Experience with event-driven architectures (e.g. Kafka, Google Pub/Sub, Azure Event Hub, etc.).
  • Professional working knowledge of CI/CD technologies such as Concourse, TeamCity, Octopus, Jenkins, and CircleCI.
  • Team player that exhibits high energy, strategic thinking, collaboration, direct communication and results orientation.

Physical Requirements

  • Visual requirements include: ability to see detail at near range with or without correction. Must be physically able to perform sedentary work: occasionally lifting or carrying objects of no more than 10 pounds, and occasionally standing or walking, reaching, handling, grasping, feeling, talking, hearing and repetitive motions.

Working Conditions

  • The duties of this position are performed through a combination of an open office setting and remote work options. Full remote work options available for employees that reside outside of the Des Moines Metro Area. There is frequent pressure to meet deadlines and handle multiple projects in a day.

Equipment Used to Perform Job

  • Windows, or Mac computer and various software solutions.

Financial Responsibility

  • Responsible for company assets including maintenance of software solutions.

Contacts

  • Has frequent contact with office personnel in other departments related to the position, as well as occasional contact with users and customers. Engages stakeholders from other area in the business.

Confidentiality

  • Has access to confidential information including trade secrets, intellectual property, various financials, and customer data.
Read more
Indian money
Praveen Vishwakarma
Posted by Praveen Vishwakarma
Remote only
0 - 1 yrs
₹2L - ₹3L / yr
Communication Skills
Learning to rank

To build the relationship with customers and explain about product
It's an Ed. Tech company authorized by the government of India and knowledge partner of NSDC

 

Read more
Hopnob
at Hopnob
1 recruiter
Parul Vashist
Posted by Parul Vashist
Gurugram
4 - 10 yrs
₹15L - ₹22L / yr
skill iconJava
skill iconNodeJS (Node.js)
skill iconPython
skill iconAndroid Development
skill iconiOS App Development
+15 more

Responsibilities:

  • Investigate technologies and solutions which help the team achieve deliverables and results.
  • Working with business process analysts and technical leads to derive conceptual designs and solutions.
  • Assisting project managers with sizing estimates and work-breakdown structures.
  • Develop and unit test software within teams of varied sizes and geographical distributions.
  • Benchmarking and load testing developed modules and integrated applications.
  • Assisting quality assurance team in the conduct of solution testing.
  • Documenting software specifications and requirements.
  • Working with infrastructure teams to define and establish application environments and implementation of software applications.
  • Provide post-implementation support for developed software applications and solutions.


Measures of Success:

  • The delivery of software solutions that meets requirements and are within budget and project timeline.
  • Achieves good quality development metrics and standards that are aligned with industry best practices.

  • Skill Requirements:
  • Knowledge of General Open System / Distributed systems platforms
  • Knowledge of cloud service like AWS, Azure, GCP
  • Experience in developing and implementing Restful APIs
  • Good understanding of Network ports/Transfer protocols.
  • Ability to process/analyze large amounts of data and logs.
  • UI and Backend Development experience (Full stack).
  • 6+ years of experience in software development within Linux environment; with a strong focus on development using JAVA, Javascript, C and BASH shell & Python scripting.
  • Experienced in structured and agile development methodologies.
  • Experienced in load testing and benchmarking tools such as JMeter, Loadrunner, etc.
  • Experienced in Linux-based database technology and versed with stored procedures.
  • Experienced in web services developments using XML, SOAP, JSON.
  • Knowledge of application security setup using common security standards like SSL, TLS, secured ciphers, etc.
  • Experienced with software versioning control using GIT.


Soft Skills:

  • Strong interpersonal and communication skills.
  • Strong problem solving and analytical skills.
  • Self-motivated and detail-oriented with a desire to design and develop top quality software products.


Basic Qualifications for Consideration:

  • Bachelor’s Degree in Computer Science or related
  • Minimum 4 years of experience
Read more
Quark Software
at Quark Software
2 recruiters
Tarun M
Posted by Tarun M
Hyderabad
3 - 4 yrs
₹3L - ₹5L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
Roles & Responsibilities
Implementing various development, testing, automation tools, and IT infrastructure
Planning the team structure, activities, and involvement in project management activities.
Managing stakeholders and external interfaces
Setting up tools and required infrastructure
Defining and setting development, test, release, update, and support processes for DevOps operation
Have the technical skill to review, verify, and validate the software code developed in the project.
Troubleshooting techniques and fixing the code bugs
Monitoring the processes during the entire lifecycle for its adherence and updating or creating new processes for improvement and minimizing the wastage
Encouraging and building automated processes wherever possible
Identifying and deploying cybersecurity measures by continuously performing vulnerability assessment and risk management
Incidence management and root cause analysis
Coordination and communication within the team and with customers
Selecting and deploying appropriate CI/CD tools
Strive for continuous improvement and build continuous integration, continuous development, and constant deployment pipeline (CI/CD Pipeline)
Mentoring and guiding the team members
Monitoring and measuring customer experience and KPIs
Managing periodic reporting on the progress to the management and the customer
Read more
MNC
MNC
Agency job
via I Squaresoft by Khadri SH
Remote only
5 - 8 yrs
₹10L - ₹20L / yr
ETL
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
SSIS
Cloud Datawarehouse
Hi,

job Description

Problem Formulation: Identifies possible options to address the business problems and must possess good understanding of dimension modelling

Must have worked on at least one end to end project using any Cloud Datawarehouse (Azure Synapses, AWS Redshift, Google Big query)

Good to have an understand of POWER BI and integration with any Cloud services like Azure or GCP

Experience of working with SQL Server, SSIS(Preferred)

Applied Business Acumen: Supports the development of business cases and recommendations. Owns delivery of project activity and tasks assigned by others. Supports process updates and changes. Solves business issues.

Data Transformation/Integration/Optimization:

The ETL developer is responsible for designing and creating the Data warehouse and all related data extraction, transformation and load of data function in the company

The developer should provide the oversight and planning of data models, database structural design and deployment and work closely with the data architect and Business analyst

Duties include working in a cross functional software development teams (Business analyst, Testers, Developers) following agile ceremonies and development practices.

The developer plays a key role in contributing to the design, evaluation, selection, implementation and support of databases solution.

Development and Testing: Develops codes for the required solution by determining the appropriate approach and leveraging business, technical, and data requirements.

Creates test cases to review and validate the proposed solution design. Work on POCs and deploy the software to production servers.

Good to Have (Preferred Skills):

  • Minimum 4-8 Years of experience in Data warehouse design and development for large scale application
  • Minimum 3 years of experience with star schema, dimensional modelling and extract transform load (ETL) Design and development
  • Expertise working with various databases (SQL Server, Oracle)
  • Experience developing Packages, Procedures, Views and triggers
  • Nice to have Big data technologies
  • The individual must have good written and oral communication skills.
  • Nice to have SSIS

 

Education and Experience

  • Minimum 4-8 years of software development experience
  • Bachelor's and/or Master’s degree in computer science

Please revert back with below details.

Total Experience:
Relevant Experience:

Current CTC:
Expected CTC:

Any offers: Y/N

Notice Period:

Qualification:

DOB:
Present Company Name:

Designation:

Domain

Reason for job change:

Current Location:

Read more
Konversations
at Konversations
1 recruiter
Vinit Singh
Posted by Vinit Singh
Mumbai
1 - 4 yrs
₹4L - ₹6L / yr
skill iconAngularJS (1.x)
skill iconLaravel
Algorithms
We are looking for a Full Stack Developer (with at least one year of experience) who is excited to innovate and conceptualise existing/new platforms for KiRa9 EduMedia. In addition to that, a web developer with a passion for coding, innovative design for web and app-based platforms is a must. The ideal candidate will not only improve his technical skills but also his business understanding while working with us. Our development team first understands the business challenge, then it comes up with creative solutions to overcome the challenge and only then does it go about executing the solution in an effective and measurable way. As a developer, you will be responsible for all aspects of development, right from initial conceptualisation, developing codes, testing the frameworks, and finally launching it. You will spend a significant portion of your time coding and documenting the specifications. You will be required to stay up-to-date with the emerging technologies and industry trends and contribute to the overall development of the platforms accordingly. Designation- Software Engineer Work Experience- 1+ Years Location- Vile Parle (Mumbai) Job Responsibilities - - Building our website from concept all the way to completion - Be responsible for maintaining, expanding, and scaling our site - You will be responsible for both front-end and back-end web development - Maintain the integrity of code and organisation for the same - Working know-how of integrations between desktop and mobile applications - Work with experienced team members to conduct root cause analysis of issues, review new and existing code - Identify ideas to improve system performance and impact availability - Resolve complex technical design issues Skills Required - - Proven working experience in web programming - Especially familiar with HTML, CSS, JavaScript, and PHP — and common frameworks (Laravel, Angular2+ preferred). - Full stack knowledge. Previous experience working in a LAMP, WAMP or MAMP environment. - Working knowledge of REST API and MVC framework - Understanding of Mongo and SQL database - Solid understanding of how web applications work including security, session management, and best development practices. - Ability to work and thrive in a fast-paced environment, learn rapidly and master diverse web technologies and techniques. - Aggressive problem diagnosis and creative problem-solving skills Please get in touch with us if working a product end-to-end is what you are looking for.
Read more
ThoughtSpot
Bengaluru (Bangalore)
3 - 11 yrs
₹20L - ₹60L / yr
Distributed Systems
System Programming
Data Structures
Algorithms
Requirements: Strong coding skills in modern languages such as C++/Javascript/Python Strong problem solving skills, algorithmic thinking and a strong foundation in how systems work. Very strong computer science fundamentals Bachelor/Masters in Computer Science, PhD preferred Experience in designing and developing scale-out, high-performance systems OR experience with database design OR experience in building search engines including areas such as search relevance, aggregation and indexing OR full stack/frontend development experience in building complex web/mobile applications is a plus. About ThoughtSpot ThoughtSpot’s AI-Driven analytics platform puts the power of a thousand analysts in every business person's hands. With ThoughtSpot, you can use search to easily analyze your data or automatically get trusted insights pushed to you with a single click. ThoughtSpot connects with any on-premise, cloud, big data, or desktop data source and deploys 85 percent faster than legacy technologies. BI & Analytics teams have used ThoughtSpot to cut reporting backlogs by more than 90 percent and make more than 3 million decisions - and counting. ThoughtSpot’s customers include Amway, Bed Bath and Beyond, Capital One, Celebrity Cruises, Chevron Federal Credit Union, De Beers, Insurethebox and Scotiabank. ThoughtSpot was co-founded in 2012 by its CEO Ajeet Singh and six other technical co-founders from Google, Microsoft, Amazon, and Oracle. The company is based in Palo Alto, CA and is currently expanding operations in North America, Europe and Asia-Pacific. Backed by investors Lightspeed Venture Partners, Khosla Ventures, General Catalyst Partners, Geodesic Capital and Capital One Growth Ventures, ThoughtSpot has raised over $160 million to date. ThoughtSpot’s mission is to enable analytics at "human scale" and put search and AI-driven analytics in the hands of 20 million users by 2020.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos