Cutshort logo
Ganit Business Solutions logo
Senior Data Engineer_AWS
Senior Data Engineer_AWS
Ganit Business Solutions's logo

Senior Data Engineer_AWS

Agency job
5.5 - 12 yrs
₹15L - ₹25L / yr
Bengaluru (Bangalore), Chennai, Mumbai
Skills
skill iconAmazon Web Services (AWS)
PySpark
SQL

Roles & Responsibilities

  • Data Engineering Excellence: Design and implement data pipelines using formats like JSON, Parquet, CSV, and ORC, utilizing batch and streaming ingestion.
  • Cloud Data Migration Leadership: Lead cloud migration projects, developing scalable Spark pipelines.
  • Medallion Architecture: Implement Bronze, Silver, and gold tables for scalable data systems.
  • Spark Code Optimization: Optimize Spark code to ensure efficient cloud migration.
  • Data Modeling: Develop and maintain data models with strong governance practices.
  • Data Cataloging & Quality: Implement cataloging strategies with Unity Catalog to maintain high-quality data.
  • Delta Live Table Leadership: Lead the design and implementation of Delta Live Tables (DLT) pipelines for secure, tamper-resistant data management.
  • Customer Collaboration: Collaborate with clients to optimize cloud migrations and ensure best practices in design and governance.

Educational Qualifications

  • Experience: Minimum 5 years of hands-on experience in data engineering, with a proven track record in complex pipeline development and cloud-based data migration projects.
  • Education: Bachelor’s or higher degree in Computer Science, Data Engineering, or a related field.
  • Skills
  • Must-have: Proficiency in Spark, SQL, Python, and other relevant data processing technologies. Strong knowledge of Databricks and its components, including Delta Live Table (DLT) pipeline implementations. Expertise in on-premises to cloud Spark code optimization and Medallion Architecture.

Good to Have

  • Familiarity with AWS services (experience with additional cloud platforms like GCP or Azure is a plus).

Soft Skills

  • Excellent communication and collaboration skills, with the ability to work effectively with clients and internal teams.
  • Certifications
  • AWS/GCP/Azure Data Engineer Certification.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Ganit Business Solutions

Founded :
2017
Type :
Products & Services
Size :
100-1000
Stage :
Bootstrapped

About

Ganit Inc. is in the business of enhancing the Decision Making Power (DMP) of businesses by offering solutions that lie at the crossroads of discovery-based artificial intelligence, hypothesis-based analytics, and the Internet of Things (IoT).


The company's offerings consist of a functioning product suite and a bespoke service offering as its solutions. The goal is to integrate these solutions into the core of their client's decision-making processes as seamlessly as possible. Customers in the FMCG/CPG, Retail, Logistics, Hospitality, Media, Insurance, and Banking sectors are served by Ganit's offices in both India and the United States. The company views data as a strategic resource that may assist other businesses in achieving growth in both their top and bottom lines of business. We build and implement AI and ML solutions that are purpose-built for certain sectors to increase decision velocity and decrease decision risk.

Read more

Connect with the team

Profile picture
Viswanath Subramanian
Profile picture
Priyanka Beria
Profile picture
Kavitha J

Company social profiles

N/A

Similar jobs

GlobalSignIn
at GlobalSignIn
2 recruiters
Chaitanya Sakinala
Posted by Chaitanya Sakinala
Remote only
2 - 6 yrs
₹12L - ₹15L / yr
skill iconNodeJS (Node.js)
MySQL
skill iconMongoDB
skill iconJavascript
skill iconExpress
+2 more

About Company: 

Snapsight is an AI-powered platform that delivers real-time event summaries in 75+ languages. We work with conferences worldwide and won the 2024 Skift Award for Most Innovative Event Tech. We're an early-stage startup scaling fast.


Join us if you want to become part of a vibrant and fast-moving product company that's on a mission to connect people around the world through events. 


Location: Remote/Work From Home 


What you'll be doing: 

  • Writing reusable, testable, and efficient code in Node.js for back-end services. 
  • Ensuring optimal and high-performance code logic for the data from/to the database. 
  • Collaborating with front-end developers on the integrations. 
  • Implementing effective security protocols, data protection measures, and storage solutions. 
  • Preparing technical specification documents for the developed features. 
  • Providing technical recommendations and suggesting improvements to the product. 
  • Writing unit test cases for APIs. 
  • Documenting code standards and practicing it. 
  • Staying updated on the advancements in the field of Node.js development. 
  • Should be open to new challenges and be comfortable in taking up new exploration tasks. 


Skills: 

  • 3-5 years of strong proficiency in Node.js and its core principles. 
  • Experience in test-driven development. 
  • Experience with NoSQL databases like MongoDB is required 
  • Experience with MySQL database 
  • RESTful/GraphQL API design and development 
  • Docker and AWS experience is a plus
  • Extensive knowledge of JavaScript, PHP, web stacks, libraries, and frameworks
  • Strong interpersonal, communication, and collaboration skills. 
  • Exceptional analytical and problem-solving aptitude 
  • Experience with a version control system like Git 
  • Knowledge about the Software Development Life Cycle Model, secure development best practices and standards, source control, code review, build and deployment, continuous integration


Read more
NonStop io Technologies Pvt Ltd
Kalyani Wadnere
Posted by Kalyani Wadnere
Pune
7 - 10 yrs
Best in industry
skill iconNodeJS (Node.js)
NestJS
skill iconExpress
skill iconPostgreSQL
Microservices
+7 more

About NonStop io Technologies:

NonStop io Technologies is a value-driven company with a strong focus on process-oriented software engineering. We specialize in Product Development and have a decade's worth of experience in building web and mobile applications across various domains. NonStop io Technologies follows core principles that guide its operations and believes in staying invested in a product's vision for the long term. We are a small but proud group of individuals who believe in the 'givers gain' philosophy and strive to provide value in order to seek value. We are committed to and specialize in building cutting-edge technology products and serving as trusted technology partners for startups and enterprises. We pride ourselves on fostering innovation, learning, and community engagement. Join us to work on impactful projects in a collaborative and vibrant environment.

We're seeking an experienced Senior Backend Engineer to join our team. As a senior backend engineer, you will be responsible for designing, developing, and deploying scalable backends for the products we build at NonStop. This includes APIs, databases, and server-side logic.


Responsibilities:

● Design, develop, and deploy backend systems, including APIs, databases, and server-side logic

● Write clean, efficient, and well-documented code that adheres to industry standards and best practices

● Code Quality: Ensure code quality through code reviews, adherence to best practices, and continuous improvement

● Mentorship: Guide and mentor team members, fostering growth and innovation

● Collaboration: Work closely with stakeholders to align technical goals with business objectives

● Problem-Solving: Analyze and resolve technical challenges promptly ● Innovation: Stay updated with the latest technology trends and integrate them into solutions


Requirements:

● At least 7+ years of experience building scalable and reliable backend systems

● Strong expertise in NodeJS/NestJS, Express, PostgreSQL

● Experience with microservices architecture and distributed systems

● Proficiency in database design (SQL and NoSQL)

● Knowledge of cloud platforms (AWS, Azure, or GCP) and CI/CD pipelines

● Deep understanding of design patterns, data structures, and algorithms

● Hands-on experience with containerization technologies like Docker and orchestration tools like Kubernetes

● Exceptional communication and leadership skills

● Strong understanding of object-oriented programming principles and design patterns

● Familiarity with automated testing frameworks and methodologies

● Excellent problem-solving skills and attention to detail

● Strong communication skills and ability to effectively lead and maintain a collaborative team environment

Read more
Virtana
at Virtana
3 candid answers
2 recruiters
Krutika Devadiga
Posted by Krutika Devadiga
Pune
5 - 10 yrs
Best in industry
skill iconPython
skill iconKubernetes
skill iconDocker
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)
+3 more

Role Overview:

Challenge convention and work on cutting edge technology that is transforming the way our customers manage their physical, virtual and cloud computing environments. Virtual Instruments seeks highly talented people to join our growing team, where your contributions will impact the development and delivery of our product roadmap. Our award-winning Virtana Platform provides the only real-time, system-wide, enterprise scale solution for providing visibility into performance, health and utilization metrics, translating into improved performance and availability while lowering the total cost of the infrastructure supporting mission-critical applications.


We are seeking an individual with knowledge in Systems Management and/or Systems Monitoring Software and/or Performance Management Software and Solutions with insight into integrated infrastructure platforms like Cisco UCS, infrastructure providers like Nutanix, VMware, EMC & NetApp and public cloud platforms like Google Cloud and AWS to expand the depth and breadth of Virtana Products.


Work Location: Pune/ Chennai


Job Type: Hybrid


Role Responsibilities:

  • The engineer will be primarily responsible for design and development of software solutions for the Virtana Platform
  • Partner and work closely with team leads, architects and engineering managers to design and implement new integrations and solutions for the Virtana Platform.
  • Communicate effectively with people having differing levels of technical knowledge.
  • Work closely with Quality Assurance and DevOps teams assisting with functional and system testing design and deployment
  • Provide customers with complex application support, problem diagnosis and problem resolution

 

Required Qualifications:

  • Minimum of 4+ years of experience in a Web Application centric Client Server Application development environment focused on Systems Management, Systems Monitoring and Performance Management Software.
  • Able to understand and comprehend integrated infrastructure platforms and experience working with one or more data collection technologies like SNMP, REST, OTEL, WMI, WBEM.
  • Minimum of 4 years of development experience with one of these high level languages like Python, Java, GO is required.
  • Bachelor's (B.E, B.Tech) or Master's degree (M.E, M.Tech. MCA) in computer science, Computer Engineering or equivalent
  •  2 years of development experience in public cloud environment using Kubernetes etc (Google Cloud and/or AWS)

 

Desired Qualifications:

  • Prior experience with other virtualization platforms like OpenShift is a plus
  • Prior experience as a contributor to engineering and integration efforts with strong attention to detail and exposure to Open-Source software is a plus
  • Demonstrated ability as a strong technical engineer who can design and code with strong communication skills
  • Firsthand development experience with the development of Systems, Network and performance Management Software and/or Solutions is a plus
  • Ability to use a variety of debugging tools, simulators and test harnesses is a plus

 

About Virtana:

Virtana delivers the industry's only broadest and deepest Observability Platform that allows organizations to monitor infrastructure, de-risk cloud migrations, and reduce cloud costs by 25% or more.

Over 200 Global 2000 enterprise customers, such as AstraZeneca, Dell, Salesforce, Geico, Costco, Nasdaq, and Boeing, have valued Virtana's software solutions for over a decade.

Our modular platform for hybrid IT digital operations includes Infrastructure Performance Monitoring and Management (IPM), Artificial Intelligence for IT Operations (AIOps), Cloud Cost Management (Fin Ops), and Workload Placement Readiness Solutions. Virtana is simplifying the complexity of hybrid IT environments with a single cloud-agnostic platform across all the categories listed above. The $30BIT Operations Management (ITOM) Software market is ripe for disruption, and Virtana is uniquely positioned for success.

Read more
IDFC Bank
Chennai
3 - 10 yrs
₹15L - ₹27L / yr
skill iconJava
skill iconGo Programming (Golang)
06692
RESTful APIs
skill iconGit
+8 more
  • Design and Develop: Architect, design, and implement high-performance Java-based backend services and applications.
  • Code Quality: Write clean, efficient, and well-documented code following industry best practices and coding standards.
  • Technical Leadership: Provide technical guidance and mentorship to junior developers, promoting best practices and fostering a collaborative environment.
  • Collaboration: Work closely with frontend developers, product managers, and other stakeholders to understand requirements and deliver robust solutions.
  • Performance Optimization: Identify and resolve performance bottlenecks and scalability issues.
  • Testing: Implement comprehensive testing strategies, including unit tests, integration tests, and end-to-end tests.
  • Continuous Improvement: Stay current with the latest industry trends, technologies, and best practices in Java/Golang development, and continuously improve our development processes.


Read more
Cornertree
at Cornertree
1 recruiter
Farid Malek
Posted by Farid Malek
Remote only
4 - 7 yrs
₹5L - ₹15L / yr
skill iconNodeJS (Node.js)
skill iconMongoDB
Mongoose
skill iconExpress
skill iconJavascript
+15 more
Qualifications:
• Bachelor’s degree in Computer Science or IT related field
• 4-6 years of experience working across different product domains in a product development/engineering role

• Good communication skills necessary to manage business requests and work with different teams across differ-
ent geographies and time-zones; experience working with remote and distributed teams will be an added ad-
vantage

• Hands-on working knowledge and experience is requiredin:
a. JavaScript, Typescript, NodeJS (Express, NestJs, etc.)
b. Experience working in GCP or AWS or Azure
c. Experience working in Containers & Unix Platforms
d. Relational Databases (PostgreSQL, MySQL, SQL, etc.)
e. Agile Methodologies (Scrum, TDD, BDD, etc.)
f. Understanding of Microservices Architecture, Domain Driver Design, Test Driven Development and
Secure Design patterns and architecture is a must
g. Data Structures and Algorithms using Javascript, Typescriptand/or other Programing Languages
h. Strong organizational skills
i. Agile Methodologies (Scrum, TDD, BDD, etc.)
• Experience with several of the following tools/technologies is desirable:
a. GIT (Bit Bucket, Gitlab, etc.), Jira, Gradle, Maven, Jenkins, SharePoint, Eclipse/IntelliJ.
b. Design Patterns and implementing the Design Patterns
c. Development of Complex Application and System Architectures
d. NoSQL Databases (Redis, Mongo, etc.)
e. Full stack development
f. Experience working with CI/CD pipelines with for example GitHub Actions.
• Knowledge of the following technologies is a plus:
a. Other Programming Languages (Java, Python, etc.)
b. Continuous Integration and Continuous Delivery Tools like Jenkins, Git, etc.
c. Secure Development based on OWASP standards
Read more
Scalex Technology Solutions
Geeta Smriti
Posted by Geeta Smriti
Remote, Pune
2 - 5 yrs
₹4L - ₹8L / yr
skill iconNodeJS (Node.js)
Node
TypeScript
skill iconJavascript
skill iconMongoDB
+2 more
JOB DESCRIPTION:
Responsibilities:
 Developing and maintaining all server-side network components.
 Ensuring optimal performance of the central database and responsiveness to front-end
requests.
 Collaborating with front-end developers on the integration of elements.
 Designing customer-facing UI and back-end services for various business processes.
 Developing high-performance applications by writing testable, reusable, and efficient code.
 Implementing effective security protocols, data protection measures, and storage solutions.
 Running diagnostic tests, repairing defects, and providing technical support.
 Documenting Node.js processes, Typescript processes including database schemas, as well as
preparing reports.
 Recommending and implementing improvements to processes and technologies.
 Keeping informed of advancements in the field of Typescript and Node.js development.
Skills:
 Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.
 2-4 years of strong proficiency in Node.js and Typescript. And core principles of javascript.
 Experience in test-driven development.
 Experience working with SQL based DBs, REST API.
 Strong interpersonal, communication, and collaboration skills.
 Exceptional analytical and problem-solving aptitude.
 Knowledge about the Software Development Life Cycle Model, development best practices
and standards, source control, code review, build and deployment, continuous integration.
Read more
GrayQuest
at GrayQuest
1 video
2 recruiters
Rishab Mehta
Posted by Rishab Mehta
Mumbai
2 - 7 yrs
₹9L - ₹16L / yr
skill iconPython
RESTful APIs
skill iconJava
skill iconDjango
Fullstack Developer
+5 more

We are hiring for a Software Engineer Team Lead - Backend, to join our education-focused fintech lending startup, GrayQuest. Our core product is a combination of a lending product, a rewards product and an insurance product to redefine the education fees payment across the country.

 

You will be joining a young and vibrant team of developers who are pushing the boundaries of consumer financing through technology.

Key Responsibilities :
  • Participate in all stages of the Software Development Lifecycle
  • Develop back-end components, services, and APIs. Support integration of user-facing elements, and collaborate closely with the design and front-end development team.
  • Write elegant, effective, and scalable code while maintaining the highest level of coding standards.
  • Take complete ownership of projects and ensure timely deliveries
  • Ability to debug, refine, review, and deploy code
  • Work closely with the QA team to test, and document project features.
  • Ability to interact with all stakeholders. Understand business requirements, and effectively convert them into technical specifications
  • Mentor junior developers and participate in peer Review

Requirements:

  • Demonstrable experience as a Python Developer (3+ years)
  • Strong knowledge of Python frameworks (Django Rest, Flask)
  • Experience working on REST APIs
  • Strong knowledge of SQL and JavaScript
  • Experience with Amazon Web Services (AWS)
  • Working knowledge of React
  • Familiarity with Agile development methodology
  • Good understanding of task breakup, milestone definition, and work delegation.
  • Past experience of working in a fintech/financial services domain or a consumer internet startup will be preferable but not required
  • Work experience in early-stage startups (0 ->1) is a big plus
  • Bachelors or equivalent degree from premier institutes is a plus
  • Most importantly, the biggest skill we look for our prospective candidates is "Learnability" - how quickly can you learn. 

Why is this a great opportunity for the right candidate:

 

  1. Work with a young dynamic core team backed by marquee investors from the financial services space
  2. Work on a product/business that has achieved product market fit and take it to scale
  3. Equity compensation and competitive market salaries
  4. Work environment that prioritizes talent, hustle and dedication

We will also ensure we give a preference to applicants who directly email us with their background/context and why they think they should be a strong candidate for this position at GrayQuest. Email us at work (at the rate) grayquest (dot) com and cc Sonal (at the rate)grayquest (dot) com

Read more
Leading American product based company
Leading American product based company
Agency job
via XL Recruiters by Anita Alva
Pune
5 - 10 yrs
₹20L - ₹25L / yr
skill icon.NET
ASP.NET
MVC Framework
skill iconAmazon Web Services (AWS)
NOSQL Databases
+2 more
5-10 years’ of industry experience in programming web applications, mobile and/or large scale
enterprise products
 Strong experience with SOLID and programming design patterns
 Strong experience of C#, ASP.NET, MVC, .Net Core
 Experience with XML, ADO/ADO.NET, LINQ, AJAX, IIS
 Extended experience with SQL, relational and non-relational databases like MongoDb,
DynamoDb
 Experience in GIT/AWS DevOps.
 Experience with Web API/ Rest API is a must.
 Experience of cloud (AWS) is a must
 Experience with Agile methodology
Read more
AnySpaces
at AnySpaces
1 recruiter
Satish B
Posted by Satish B
Bengaluru (Bangalore)
3 - 6 yrs
₹10L - ₹15L / yr
skill iconJava
Spring
Hibernate (Java)
Data Structures
Algorithms
+3 more
Responsibilities: Betterment: a tireless pursuit to drive results. Boldness: take risks and act decisively. Deep Honesty: invite and offer candid feedback in order to learn, change, and grow. Solidarity: recognize that we are part of something bigger than ourselves and are committed to our mission. Design and implement scalable systems and infrastructures. Measure your work thoroughly, analyze results, and generate hypotheses to drive new product changes through A/B testing. Setup monitoring and testing of your APIs and services to better understand real time health of your products. Break-down complex problems into solvable pieces of work for other Engineers. Depending on your specialization, projects/initiatives may include: Security, scaling distributed systems, working on our core services related to user management, building out new verticals, guiding new engagement features, scaling traffic/imports/exports, managing APIs. Requirements: 4+ years of experience working in a relevant software engineering role. Expertise in designing highly-scalable and performant micro-services and storage layers using common frameworks, languages, and infrastructure (e.g. Java, MySql, AWS, Docker). Comfortable working in a fast-moving team environment. Data-driven and strongly motivated by success and learnings through experiments and metrics analysis. SaaS /Internet company background: web-based, hosted on AWS. Experience in an Agile and Scrum environment.
Read more
liquiloans
at liquiloans
5 recruiters
Sunil Liquiloans
Posted by Sunil Liquiloans
Mumbai
2 - 5 yrs
₹4L - ₹15L / yr
skill iconLaravel
skill iconPHP
MySQL
skill iconAmazon Web Services (AWS)
We are looking for a PHP Laravel Developer responsible for managing back-end services and the interchange of data between the server and the users. Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end. You will also be responsible for integrating the front-end elements built by your co-workers into the application. Therefore, a basic understanding of front-end technologies is necessary as well.Responsibilities:1. Integration of user-facing elements developed by front-end developers2. Build efficient, testable, and reusable PHP modules3. Third Party Integrations4. Building dashboards5. Unit testing
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos