Data Engineer- SQL+PySpark

at Fragma Data Systems

Data Engineer- SQL+PySpark

Fragma Data Systems

Company

Home

Data Engineer- SQL+PySpark

at Fragma Data Systems

Posted by Evelyn Charles

1 - 5 yrs

₹5L - ₹15L / yr

Remote, Bengaluru (Bangalore)

Skills

Spark

PySpark

Big Data

Python

SQL

Windows Azure

Must-Have Skills:

• Good experience in Pyspark - Including Dataframe core functions and Spark SQL

• Good experience in SQL DBs - Be able to write queries including fair complexity.

• Should have excellent experience in Big Data programming for data transformation and aggregations

• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.

• Good customer communication.

• Good Analytical skill

Technology Skills (Good to Have):

Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
Experience in migrating on-premise data warehouses to data platforms on AZURE cloud.
Designing and implementing data engineering, ingestion, and transformation functions
Azure Synapse or Azure SQL data warehouse
Spark on Azure is available in HD insights and data bricks

Must-Have Skills:

• Good experience in Pyspark - Including Dataframe core functions and Spark SQL

• Good experience in SQL DBs - Be able to write queries including fair complexity.

• Should have excellent experience in Big Data programming for data transformation and aggregations

• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.

• Good customer communication.

• Good Analytical skill

Technology Skills (Good to Have):

Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
Experience in migrating on-premise data warehouses to data platforms on AZURE cloud.
Designing and implementing data engineering, ingestion, and transformation functions
Azure Synapse or Azure SQL data warehouse
Spark on Azure is available in HD insights and data bricks

Users love Cutshort

Read about what our users have to say about finding their next opportunity on Cutshort.

Subodh Popalwar

Software Engineer, Memorres

For 2 years, I had trouble finding a company with good work culture and a role that will help me grow in my career. Soon after I started using Cutshort, I had access to information about the work culture, compensation and what each company was clearly offering.

Companies hiring on Cutshort

About Fragma Data Systems

Founded :

2015

Type :

Products & Services

Size

Stage :

Profitable

About

Fragma is a leading Big data, AI and Advanced analytics company provideing services global clients.

Connect with the team

Mallikarjun Degul

Sandhya JD

Varun Reddy

Priyanka U

Simpy kumari

Minakshi Kumari

Latha Yuvaraj

Vamsikrishna G

Company social profiles

Similar jobs

Backend Developer

Advance Analytics

Agency job

via HR BIZ HUB by Pooja shankla

Indore

1 - 2 yrs

₹3L - ₹6L / yr

Go Programming (Golang)

Ruby on Rails (ROR)

Ruby

Python

Java

+7 more

Job Title: Backend Developer

Job Description: We are seeking a skilled Backend Developer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining the server-side logic, databases, and APIs of our applications. Key responsibilities include collaborating with cross-functional teams to develop scalable and efficient backend systems, troubleshooting and resolving issues, and staying updated on industry trends. Proficiency in programming languages such as Python, Java, or Node.js, along with experience in database management and API development, are essential for success in this role. Strong problem-solving skills, attention to detail, and a passion for creating robust and high-performance backend solutions are highly valued.

Requirements:

Proficiency in one or more backend programming languages (e.g., Python, Java, Node.js)

Experience with database management systems (e.g., MySQL, PostgreSQL, MongoDB)

Knowledge of RESTful API design and development

Familiarity with cloud services (e.g., AWS, Azure) is a plus

Strong problem-solving and troubleshooting skills

Collaborative mindset with excellent communication skills

Ability to work in a fast-paced and dynamic environment

Job Title: Backend Developer

Requirements:

Proficiency in one or more backend programming languages (e.g., Python, Java, Node.js)

Experience with database management systems (e.g., MySQL, PostgreSQL, MongoDB)

Knowledge of RESTful API design and development

Familiarity with cloud services (e.g., AWS, Azure) is a plus

Strong problem-solving and troubleshooting skills

Collaborative mindset with excellent communication skills

Ability to work in a fast-paced and dynamic environment

Android Engineer

at KoinBX

Posted by Niyati Jalali

Bengaluru (Bangalore)

3 - 7 yrs

Best in industry

Android Development

Kotlin

Java

Model-View-View-Model (MVVM)

WebSocket

+1 more

KoinBX is a trusted cryptocurrency exchange that unlocks a world of limitless possibilities in the realm of digital assets. Our platform empowers both seasoned traders and newcomers alike to participate in the fast-paced and ever-evolving crypto market. With a user-centric approach, advanced security measures, and an extensive array of cryptocurrencies, KoinBX is your gateway to the future of finance

Job Description:

We are seeking a dedicated Android developer to join our growing company. You will collaborate as part of a team of developers to work on creating and maintaining Android apps.

As an Android developer, you will need to be familiar with the Android ecosystem and mobile app development, including familiarity with popular app frameworks and software development best practices. Your duties will include maintaining existing codebases, including bug fixing, and creating apps from scratch as part of a team while following all coding guidelines and industry best practices.

Responsibilities:

Design and implement scalable, robust, and maintainable Android applications for our centralized cryptocurrency exchange platform.
Collaborate with product managers and designers to translate requirements and wireframes into high-quality code and user interfaces.
Ensure the performance, quality, and responsiveness of the Android application.
Optimize application performance for mobile devices, including memory usage, battery consumption, and network efficiency.
Participate in code reviews, knowledge sharing, and continuous improvement initiatives to enhance team productivity and code quality.
Work closely with backend developers to integrate APIs and implement new features seamlessly.
Write unit and integration tests to ensure code quality, reliability, and scalability.
Contribute to the overall architecture, design, and development of our Android application, adhering to coding standards and best practices.

Qualifications:

Proven experience developing Android applications, with a strong portfolio of published apps on the Google Play Store.
Proficiency in or Kotlin programming languages, along with a deep understanding of the Android SDK, Android Studio, and related development tools.
Solid understanding of mobile UI/UX design principles, patterns, and best practices.
Experience with RESTful APIs, JSON, and web services integration.
Familiarity with version control systems such as Git.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Passion for cryptocurrencies, blockchain technology, and financial markets is a plus.

Job Description:

We are seeking a dedicated Android developer to join our growing company. You will collaborate as part of a team of developers to work on creating and maintaining Android apps.

Responsibilities:

Design and implement scalable, robust, and maintainable Android applications for our centralized cryptocurrency exchange platform.
Collaborate with product managers and designers to translate requirements and wireframes into high-quality code and user interfaces.
Ensure the performance, quality, and responsiveness of the Android application.
Optimize application performance for mobile devices, including memory usage, battery consumption, and network efficiency.
Participate in code reviews, knowledge sharing, and continuous improvement initiatives to enhance team productivity and code quality.
Work closely with backend developers to integrate APIs and implement new features seamlessly.
Write unit and integration tests to ensure code quality, reliability, and scalability.
Contribute to the overall architecture, design, and development of our Android application, adhering to coding standards and best practices.

Qualifications:

Proven experience developing Android applications, with a strong portfolio of published apps on the Google Play Store.
Proficiency in or Kotlin programming languages, along with a deep understanding of the Android SDK, Android Studio, and related development tools.
Solid understanding of mobile UI/UX design principles, patterns, and best practices.
Experience with RESTful APIs, JSON, and web services integration.
Familiarity with version control systems such as Git.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Passion for cryptocurrencies, blockchain technology, and financial markets is a plus.

Technical Project Manager

at Simform

1 video

2 recruiters

Posted by Satendra Chauhan

Ahmedabad

7 - 14 yrs

₹13L - ₹15L / yr

Project Management

Software project management

IT project management

Agile/Scrum

Design patterns

We are a digital product engineering company looking for an awesome Project Manager with a diverse technology background to help our clients build quality software products.

You should have a good understanding of software product development and lead a team of developers and designers to deliver custom solutions for our clients.

Role + Responsibilities:

Manage projects using agile/scrum methodologies throughout full life-cycle of projects
Gather and understand requirements, transform and triage requirements into documents, user stories, etc.
Plan sprints, assign tasks, do daily scrum meetings, communicate with clients, identify risks, create test/release plans, review test cases etc.
Decipher through ambiguity to clearly define and communicate deliverables, timing and scope information internally and externally, as needed.
Use your technical expertise in web/mobile/cloud technologies to drive improvements delivery quality
Deciding on architecture and approach to the projects, providing technical guidance to the developers, checking their progress and status of the projects.
Ensuring that the applications and the programs do not have glitches, errors, or low functionality.
Well-versed in fundamental visual and UX design skills including responsive design.

Requirements

Technical background with over 5 years dabbling into multiple technologies and grasping crux of them.
Experience with managing and mentoring teams to deliver projects successfully.
Experience with SCRUM/Agile methodologies medium to large scale application development projects.
Strong interpersonal skills including mentoring, coaching, collaborating, and team building.
Creative approach to problem-solving with the ability to focus on details while maintaining the “big picture” view
Exposure and expertise in design patterns and software design patterns in general
Experience with developing complex projects/programs from design and development to production.

We are a digital product engineering company looking for an awesome Project Manager with a diverse technology background to help our clients build quality software products.

You should have a good understanding of software product development and lead a team of developers and designers to deliver custom solutions for our clients.

Role + Responsibilities:

Manage projects using agile/scrum methodologies throughout full life-cycle of projects
Gather and understand requirements, transform and triage requirements into documents, user stories, etc.
Plan sprints, assign tasks, do daily scrum meetings, communicate with clients, identify risks, create test/release plans, review test cases etc.
Decipher through ambiguity to clearly define and communicate deliverables, timing and scope information internally and externally, as needed.
Use your technical expertise in web/mobile/cloud technologies to drive improvements delivery quality
Deciding on architecture and approach to the projects, providing technical guidance to the developers, checking their progress and status of the projects.
Ensuring that the applications and the programs do not have glitches, errors, or low functionality.
Well-versed in fundamental visual and UX design skills including responsive design.

Requirements

Technical background with over 5 years dabbling into multiple technologies and grasping crux of them.
Experience with managing and mentoring teams to deliver projects successfully.
Experience with SCRUM/Agile methodologies medium to large scale application development projects.
Strong interpersonal skills including mentoring, coaching, collaborating, and team building.
Creative approach to problem-solving with the ability to focus on details while maintaining the “big picture” view
Exposure and expertise in design patterns and software design patterns in general
Experience with developing complex projects/programs from design and development to production.

Business Development Executive

at Vega Moon Technologies

Posted by Himanshi Tiwari

Kanpur

2 - 3 yrs

₹2L - ₹3.5L / yr

Business Development

Sales

Communication Skills

Effective communication

Lead Generation

+1 more

Business Development Executive Job Description

We are looking for an ambitious and energetic Business Development Executive to help us expand our clientele. Candidate must have the dedication to work in the team, boost sales and forging strong relationships with clients

Key Skills: Online Bidding, Upwork, Freelancer, Guru, Lead Generation, Client Interaction.

Skills & Responsibilities

· Online Lead Generation via Upwork, Freelancer, Guru, etc.

· Lead Generation via Email Marketing

· Excellent Analytical & Communication Skills (Written and Oral)

· Email Etiquette, Proposal Writing, Follow-up and Requirement Gathering.

· Client Interaction.

· Understanding of the Demand and Supply of Software Outsourcing, Web Design, Web Development, Mobile App Development.

· Prepare business reviews to the senior management team regarding progress and roadblocks to closing new enterprise customers.

Experience - 2 to 3 year must

IT Company

Full Time office Job

Fixed Salary + incentives

International and Domestic

Web Design and Development Company

Business Development Executive Job Description

Key Skills: Online Bidding, Upwork, Freelancer, Guru, Lead Generation, Client Interaction.

Skills & Responsibilities

· Online Lead Generation via Upwork, Freelancer, Guru, etc.

· Lead Generation via Email Marketing

· Excellent Analytical & Communication Skills (Written and Oral)

· Email Etiquette, Proposal Writing, Follow-up and Requirement Gathering.

· Client Interaction.

· Understanding of the Demand and Supply of Software Outsourcing, Web Design, Web Development, Mobile App Development.

· Prepare business reviews to the senior management team regarding progress and roadblocks to closing new enterprise customers.

Experience - 2 to 3 year must

IT Company

Full Time office Job

Fixed Salary + incentives

International and Domestic

Web Design and Development Company

BI Engineer

Sixt R&D

Agency job

via Hiringhut Solutions Pvt Ltd by Rashmi R

Bengaluru (Bangalore)

5 - 8 yrs

₹11L - ₹14L / yr

SQL

Python

RESTful APIs

Business Intelligence (BI)

QuickSight

+6 more

Technical-Requirements:

Bachelor's Degree in Computer Science or a related technical field, and solid years of relevant experience.
A strong grasp of SQL/Presto and at least one scripting (Python, preferable) or programming language.
Experience with an enterprise class BI tools and it's auditing along with automations using REST API's.
Experience with reporting tools – QuickSight (preferred, at least 2 years hands on).
Tableau/Looker (both or anyone would suffice with at least 5+ years of hands on).
5+ years of experience with and detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding.
5+ years of demonstrated quantitative and qualitative business intelligence.
Experience with significant product analysis based business impact.
4+ years of large IT project delivery for BI oriented projects using agile framework.
2+ years of working with very large data warehousing environment.
Experience in designing and delivering cross functional custom reporting solutions.
Excellent oral and written communication skills including the ability to communicate effectively with both technical and non-technical stakeholders.
Proven ability to meet tight deadlines, multi-task, and prioritize workload.
A work ethic based on a strong desire to exceed expectations.
Strong analytical and challenge process skills.

Technical-Requirements:

Bachelor's Degree in Computer Science or a related technical field, and solid years of relevant experience.
A strong grasp of SQL/Presto and at least one scripting (Python, preferable) or programming language.
Experience with an enterprise class BI tools and it's auditing along with automations using REST API's.
Experience with reporting tools – QuickSight (preferred, at least 2 years hands on).
Tableau/Looker (both or anyone would suffice with at least 5+ years of hands on).
5+ years of experience with and detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding.
5+ years of demonstrated quantitative and qualitative business intelligence.
Experience with significant product analysis based business impact.
4+ years of large IT project delivery for BI oriented projects using agile framework.
2+ years of working with very large data warehousing environment.
Experience in designing and delivering cross functional custom reporting solutions.
Excellent oral and written communication skills including the ability to communicate effectively with both technical and non-technical stakeholders.
Proven ability to meet tight deadlines, multi-task, and prioritize workload.
A work ethic based on a strong desire to exceed expectations.
Strong analytical and challenge process skills.

Engineering Manager

at BigStep Technologies Pvt Ltd

1 video

3 recruiters

Posted by Pratishtha Thakur

Remote only

8 - 12 yrs

₹15L - ₹30L / yr

Engineering Management

Engineering Manager

Engineering Head

Technical Architecture

Technical Lead

+3 more

As an Engineering Manager at BigStep Technologies, you will be part of a fast-growing business that allows high-performing employees to make an impact and contribute to the business growth. You will have the opportunity to channel your experience into contributing towards the development of our enterprise-grade software platforms. You will act as a driving force and ensure that optimized solutions are developed using Agile-based development methodology. In this role, you will be collaborating closely with multiple cross-functional teams. Primary responsibilities would also include coaching software development teams to self-organise and create high-value products to remove any impediments to their progress.

This is an excellent opportunity to make an impact on a massive scale, with room for growth in personal and professional development, while working with foundational next-generation technologies. This engineering managers role offers the opportunity for significant technical impact, product innovation and team building with the opportunity for advancement.

Roles and Responsibilities:

Lead our platforms engineering team.
Form and drive the platform's technical strategy and road-map, making sure they are executed properly.
Collaborate with Product Managers and Tech Leads for road-map delivery.
Take ownership of on-time and with quality delivery of major/minor releases with the product teams to drive internal and external adoption of our platform.
Be an inspiring, inclusive and collaborative leader for a team of strong engineers responsible for delivering on business value.
Your technical contribution scope won't be limited just into cycle delivery goals, but there is an expectation that you engage in technical deliverables such as RFC reviews, bug fixes, and small features, without blocking or slowing down your teams progress.
You will be responsible for identifying the process bottlenecks and clearing any potential roadblocks.
You will play a role in building the team with the right culture, partnering with other teams, planning sprints and executing the plans.
You are expected to contribute as an active member of the global product team, a member of our leadership team responsible for delivering high business values.

Desired Candidate Profile:

B.E / M.E with specialization in Computer Science / Information Technology.
Diverse experience of 8-12 years in a hyper-growth environment.
A minimum experience of 3 years in development and technical leadership role
A minimum experience of 2 years in managing Scrum Teams.
Extensive experience in designing and developing software applications by putting the latest technology stacks to use in an Agile environment.
Prior hands-on experience working through the design, development and release cycle.
Hands on experience in full stack development, including RESTful API, JavaScript (jQuery, Angular/React, NodeJS, etc.), MongoDB, server component technologies
Experience using Agile performance metrics to drive accountability and continuous improvement.
Proven leadership and motivational skills and the ability to maintain high levels of energy and engagement.

Roles and Responsibilities:

Lead our platforms engineering team.
Form and drive the platform's technical strategy and road-map, making sure they are executed properly.
Collaborate with Product Managers and Tech Leads for road-map delivery.
Take ownership of on-time and with quality delivery of major/minor releases with the product teams to drive internal and external adoption of our platform.
Be an inspiring, inclusive and collaborative leader for a team of strong engineers responsible for delivering on business value.
Your technical contribution scope won't be limited just into cycle delivery goals, but there is an expectation that you engage in technical deliverables such as RFC reviews, bug fixes, and small features, without blocking or slowing down your teams progress.
You will be responsible for identifying the process bottlenecks and clearing any potential roadblocks.
You will play a role in building the team with the right culture, partnering with other teams, planning sprints and executing the plans.
You are expected to contribute as an active member of the global product team, a member of our leadership team responsible for delivering high business values.

Desired Candidate Profile:

B.E / M.E with specialization in Computer Science / Information Technology.
Diverse experience of 8-12 years in a hyper-growth environment.
A minimum experience of 3 years in development and technical leadership role
A minimum experience of 2 years in managing Scrum Teams.
Extensive experience in designing and developing software applications by putting the latest technology stacks to use in an Agile environment.
Prior hands-on experience working through the design, development and release cycle.
Hands on experience in full stack development, including RESTful API, JavaScript (jQuery, Angular/React, NodeJS, etc.), MongoDB, server component technologies
Experience using Agile performance metrics to drive accountability and continuous improvement.
Proven leadership and motivational skills and the ability to maintain high levels of energy and engagement.

Ruby on Rails Developer

at gingerCube

3 recruiters

Posted by Gurmeet Singh

Mumbai

4 - 9 yrs

₹11L - ₹14L / yr

Ruby on Rails (ROR)

Javascript

MongoDB

PostgreSQL

Heroku

gingerCube Inc., based in Dallas, USA, provides a software platform to interface with hospitals, physician groups, resident programs, and billing services, improving revenue cycle and reducing time to bill by up to 85%. Our flagship product, maxRVU has been adopted by physician groups, hospitals and revenue cycle companies across the US. Over the past 6 years, we have developed a solid brand and continue to grow swiftly with top healthcare systems.

To meet rapid expansion, we are looking to hire a full-time Lead Engineer to join our growing team in Mumbai to build our products using Ruby on Rails. As our Lead Engineer, you will be responsible for creating innovative solutions to technical problems and deliver a top-notch user-experience to our enterprise customers. You must be highly motivated, lead by example and have a knack for designing optimized solutions.

You will report to the Director of Product Delivery and work at our office at a fun and open co-working space. Our startup-like environment means nothing holds you back from doing your best and chart your own growth path. You'll be able to see the impact of your work immediately, experience various aspects of the business, and hear from clients how your efforts benefit them directly.

Requirements:

Bachelor's degree in a related area and 4 to 6 years of experience in the field
Full stack with Ruby on Rails, HTML, CSS, and JavaScript.
Familiarity with ruby gems and Github.
Expertise of diverse technology stacks
An understanding of sound database design principles and performance optimization
Experience integrating with REST API’s
Skilled with debugging tools, test harnesses, and performance tuning
Expert with multi-tenant systems, secure coding practices, and authentication/authorization
Expert in Ruby with a distinguished track record of solving challenging and complex problems efficiently
Excellent knowledge of standard concepts, practices, and procedures within a particular field
Enable RoR web applications on Heroku with Postgres
Ability to take ownership of work and respond to critical issues quickly and work with the team.
Plus: Software security practices for patient records(HIPAA), PCI, etc. and exposure to the healthcare industry.

Requirements:

Bachelor's degree in a related area and 4 to 6 years of experience in the field
Full stack with Ruby on Rails, HTML, CSS, and JavaScript.
Familiarity with ruby gems and Github.
Expertise of diverse technology stacks
An understanding of sound database design principles and performance optimization
Experience integrating with REST API’s
Skilled with debugging tools, test harnesses, and performance tuning
Expert with multi-tenant systems, secure coding practices, and authentication/authorization
Expert in Ruby with a distinguished track record of solving challenging and complex problems efficiently
Excellent knowledge of standard concepts, practices, and procedures within a particular field
Enable RoR web applications on Heroku with Postgres
Ability to take ownership of work and respond to critical issues quickly and work with the team.
Plus: Software security practices for patient records(HIPAA), PCI, etc. and exposure to the healthcare industry.

Fullstack Developer

at Sigmaway

2 recruiters

Posted by Gosigmaway Consulting Services Pvt. Ltd.

NCR (Delhi | Gurgaon | Noida)

0 - 1 yrs

₹2L - ₹3L / yr

NodeJS (Node.js)

MongoDB

Javascript

PHP

Python

+7 more

SigmaWay is hiring fullstack developer..

SigmaWay is hiring fullstack developer..

Head of IT

at Charzera Tech Pvt Ltd

1 recruiter

Posted by Shruti Sood

Bengaluru (Bangalore)

3 - 7 yrs

₹8L - ₹10L / yr

Amazon Web Services (AWS)

Google Cloud Platform (GCP)

Cloud Computing

SQL server

NOSQL Databases

+7 more

Job Role will be like:

Develop or integrate with a Charging management system (CMS).
Develop the backend for the apps (subscription, locating, reservation, payments, operation).
Develop the backend for the host apps (setting availability, pricing).
Develop the central dashboard for internal purposes.
Develop the dashboard for monthly revenue remittance to hosts.
Develop a dashboard for network partners.
Develop the system for custom ad delivery in invoices.
Setup, Deploy and Manage the servers and APIs.

Job Role will be like:

Develop or integrate with a Charging management system (CMS).
Develop the backend for the apps (subscription, locating, reservation, payments, operation).
Develop the backend for the host apps (setting availability, pricing).
Develop the central dashboard for internal purposes.
Develop the dashboard for monthly revenue remittance to hosts.
Develop a dashboard for network partners.
Develop the system for custom ad delivery in invoices.
Setup, Deploy and Manage the servers and APIs.

Java Developer

at JS TechAlliance Consulting Pvt Ltd.

7 recruiters

Posted by Kumar Anand

Indore

3 - 7 yrs

₹3L - ₹5L / yr

J2EE

Spring

Spring MVC

JavaFX

XMPP

+3 more

We are working on few challenging product in Java . We need developer who can be product owner later . I would like to discuss more about product and position to suitable candidate .

Why apply to jobs via Cutshort