Cutshort logo
Agivant Technologies logo
Data Engineer (Snowflake + Airflow)
Agivant Technologies
Data Engineer (Snowflake + Airflow)
Agivant Technologies's logo

Data Engineer (Snowflake + Airflow)

at Agivant Technologies

5 - 10 yrs
₹18L - ₹25L / yr
Remote only
Skills
skill iconPython
SQL
Airflow
Snowflake
skill iconElastic Search
ETL
Pipeline management
skill iconAmazon Web Services (AWS)

Experience: 5-8 Years

Work Mode: Remote

Job Type: Fulltime

Mandatory Skills: Python,SQL, Snowflake, Airflow, ETL, Data Pipelines, Elastic Search, & AWS.


Role Overview:

We are looking for a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes.


Responsibilities:

  • Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
  • Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
  • Build and optimize data pipelines using a variety of technologies, including Elastic Search, AWS S3, Snowflake, and NFS.
  • Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
  • Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
  • Collaborate with data scientists and analysts to ensure data accessibility and usability for various analytical purposes.
  • Stay current with industry best practices, CI/CD/DevSecFinOps, Scrum and emerging technologies in data engineering.
  • Contribute to the development and enhancement of our data warehouse architecture

Required Skills:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience as a Data Engineer with a strong focus on ELT/ETL processes.
  • At least 3+ years of exp in Snowflake data warehousing technologies.
  • At least 3+ years of exp in creating and maintaining Airflow ETL pipelines.
  • Minimum 3+ years of professional level experience with Python languages for data manipulation and automation.
  • Working experience with Elastic Search and its application in data pipelines.
  • Proficiency in SQL and experience with data modelling techniques.
  • Strong understanding of cloud-based data storage solutions such as AWS S3.
  • Experience working with NFS and other file storage systems.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.


Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs

Ekloud INC
Ankita G
Posted by Ankita G
Remote only
5 - 7 yrs
₹12L - ₹16L / yr
snowflake
Snow flake schema
skill iconPython
snow pipe

Snowflake Data Engineer


Job Description:


·        Overall Experience : 5+ years of experience in Snowflake and Python.

·        Experience of 5+ years in data preparation. BI projects to understand business requirements in BI context and understand data model to transform raw data into meaningful data using snowflake and Python.

·        Designing and creating data models that define the structure and relationships of various data elements within the organization. This includes conceptual, logical, and physical data models, which help ensure data accuracy, consistency, and integrity.

·        Designing data integration solutions that allow different systems and applications to share and exchange data seamlessly. This may involve selecting appropriate integration technologies, developing ETL (Extract, Transform, Load) processes, and ensuring data quality during the integration process.

·        Create and maintain optimal data pipeline architecture.

·        Good knowledge of cloud platforms like AWS/Azure/GCP

·        Good hands-on knowledge of Snowflake is a must. Experience with various data ingestion methods (Snow pipe & others), time travel and data sharing and other Snowflake capabilities

·        Good knowledge of Python/Py Spark, advanced features of Python

·        Support business development efforts (proposals and client presentations).

·        Ability to thrive in a fast-paced, dynamic, client-facing role where delivering solid work products to exceed high expectations is a measure of success.

·        Excellent leadership and interpersonal skills.

·        Eager to contribute to a team-oriented environment.

·        Strong prioritization and multi-tasking skills with a track record of meeting deadlines.

·        Ability to be creative and analytical in a problem-solving environment.

·        Effective verbal and written communication skills.

·        Adaptable to new environments, people, technologies, and processes

·        Ability to manage ambiguity and solve undefined problems.

Read more
Learning Spiral Limited
Raipur
5 - 8 yrs
₹8L - ₹10L / yr
skill iconAmazon Web Services (AWS)
skill iconKubernetes
skill iconDocker
DevOps
CI/CD
+1 more

We are looking for a proactive and detail-oriented AWS Project Manager / AWS Administrator to join our team. The ideal candidate will be responsible for configuring, monitoring, and managing AWS cloud services while optimizing usage, ensuring compliance, and driving automation across deployments.


Key Responsibilities:


1) Configure and manage AWS Cloud services including VPCs, URL proxies, Bastion Hosts, and C2S access points.

2) Monitor AWS resources and ensure high availability and performance.

3) Automate deployment processes to reduce manual efforts and enhance operational efficiency.

4) Daily cost monitoring and backup setup for EC2 source code to S3.

5) Manage AWS Elastic Beanstalk (EB), RDS, CloudFront, Load Balancer, and NAT Gateway traffic.

6) Implement security and compliance best practices using AWS Secret Manager, IAM, and organizational policies.

7) Perform system setup for CBT (Computer-Based Test) exams.

8) Utilize AWS Pricing Calculator for resource estimation and budgeting.

9) Implement RI (Reserved Instance) and Spot Instance strategies for cost savings.

10) Create and manage S3 bucket policies with controlled access, especially for specific websites.

11) Automate disaster recovery and backup strategies for RDS and critical infrastructure.

12) Configure and manage AWS environments using EB, RDS, and routing setups.

13) Create and maintain AWS CloudFormation templates for infrastructure as code.

14) Develop comprehensive documentation for all AWS-related activities and configurations.

15) Ensure adherence to AWS best practices in all deployments and services.

16) Handle account creation, policy management, and SSO configuration for organizational identity management.

17) Ability to configure and design AWS architecture.


Required Skills:


·  Strong understanding of AWS services and architecture.

·  Hands-on experience with:

1) Elastic Beanstalk (EB)

2) RDS

3) EC2

4) S3

5) CloudFront

6) Load Balancer & NAT Gateway

7) CloudFormation

8) IAM, SSO & Identity Management

·  Proficient in AWS cost optimization techniques.

·  Ability to automate regular tasks and create efficient workflows.

·  Clear and structured documentation skills.


Preferred Qualifications:


AWS Certified Solutions Architect (required).

Must have 5+ years of experience in this field.

Previous experience in managed AWS services.

Read more
Elysium Labs Pvt Ltd
Avani Mathur
Posted by Avani Mathur
Remote only
0 - 2 yrs
₹10L - ₹12L / yr
skill iconPHP
SQL
SQL server
skill iconAmazon Web Services (AWS)
Google Cloud Platform (GCP)

We are a technology company operating in the media space. We are the pioneers of robot journalism in India. We use the mix of AI-generated and human-edited content, across media formats, be it audio, video or text.

Our key products include India’s first explanatory journalism portal (NewsBytes), a content platform for developers (DevBytes), and a SaaS platform for content creators (YANTRA).

Our B2C media products are consumed by more than 50 million users in a month, while our AI-driven B2B content engine helps companies create text-based content at scale.

The company was started by IIT, IIM Ahmedabad alumni and Cornell University. It has raised institutional financing from well-renowned media-tech VC and a Germany-based media conglomerate.

We are hiring a talented DevOps Engineer with 3+ years of experience to join our team. If you're excited to be part of a winning team, we are a great place to grow your career.

Responsibilities

●       Handle and optimise cloud (servers and CDN)

●       Build monitoring tools for the infrastructure

●       Perform a granular level of analysis and optimise usage

●       Help migrate from a single cloud environment to multi-cloud strategy

●       Monitor threats and explore building a protection layer

●       Develop scripts to automate certain aspects of the deployment process

 

Requirements and Skills

●       0-2 years of experience as a DevOps Engineer

●       Proficient with AWS and GCP

●       A certification from relevant cloud companies

●       Knowledge of PHP will be an advantage

●       Working knowledge of databases and SQL

 

Read more
Bidgely
at Bidgely
4 candid answers
2 recruiters
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
3 - 8 yrs
₹20L - ₹40L / yr
skill iconJava
skill iconSpring Boot
NOSQL Databases
SQL
skill iconAmazon Web Services (AWS)
+13 more
Responsibilities

● Design and deliver scalable web services, APIs, and backend data modules.
Understand requirements and develop reusable code using design patterns &
component architecture and write unit test cases.

● Collaborate with product management and engineering teams to elicit &
understand their requirements & challenges and develop potential solutions

● Stay current with the latest tools, technology ideas, and methodologies; share
knowledge by clearly articulating results and ideas to key decision-makers.

Requirements

● 3-6 years of strong experience in developing highly scalable backend and
middle tier. BS/MS in Computer Science or equivalent from premier institutes
Strong in problem-solving, data structures, and algorithm design. Strong
experience in system architecture, Web services development, highly scalable
distributed applications.

● Good in large data systems such as Hadoop, Map Reduce, NoSQL Cassandra, etc.. Fluency in Java, Spring, Hibernate, J2EE, REST Services Ability to deliver code
quickly from given scenarios in a fast-paced start-up environment.

● Attention to detail. Strong communication and collaboration skills.
Read more
Rejolut
at Rejolut
1 video
2 recruiters
TalentA Team
Posted by TalentA Team
Navi Mumbai
2 - 7 yrs
₹1L - ₹13L / yr
Terraform
Ansible
DevOps Engineer
Navi Mumbai 1 - 3 years


Rejolut is among the fastest-growing and award-winning Tech companies working on leading
technologies namely Blockchain, Machine Learning & Artificial Intelligence, Complex mobile & Web
Apps, IoT, etc.Rejolut is a venture-backed company with clients in over several countries namely
Malaysia Airlines,gba global,my-earth,biomes, Dlg-hub,etc.

We are looking for Tech geeks having hands-on experience and in love with building scalable,
distributed and large web/mobile products and tech solutions. He/She must be an excellent problem
solver with passion to self-learn and implement web technologies (frontend + backend). He/She would
be responsible for the architecture design, code review, and technology build and deployment
activities of the product.



Key Skills For DevOps Engineer:

Background in linux\unix systems
Experience with DevOps techniques and philosophies
Experience with automation of code builds and deployments
Knowledge/Experience of CI\CD pipelines to a wide variety of virtual environments in private
and public cloud providers (Jenkins / Hudson, Docker, Kubernetes, Azure, AWS)
Knowledge/Experience of software configuration management systems and source code
version control systems (Jenkins, Bitbucket, consul, vagrant, Chef, Puppet, Gerrit)
Passion to work in an exciting fast paced environment
Self-starter who can implement with minimal guidance
High Availability: Load Balancing (ELB), Reverse Proxies, CDNs etc.
AWS core components (or their GCP/Azure equivalents) and their management: EC2, ELB,
NAT, VPC, IAM Roles and policies, EBS and S3, CloudFormation, Elasticache, Route53, etc.
Work with K8s and Docker is plus
High social and communication skills



Job Responsibilities:

Gather and analyse cloud infrastructure requirements
Automate
Support existing infrastructure, analyse problem areas and come up with solutions
Optimise stack performance and costs
An eye for monitoring. The ideal candidate should be able to look at complex infrastructure
and be able to figure out what to monitor and how.


Rejolut - As a Career Differentiator
- We are a young and dynamic team who are obsessed with solving futuristic and evolutionary
business problems at scale with the next generation technology like blockchain, crypto and machine
learning. Focuses on empowering people across the globe to be technically efficient, making
advancements in technology and providing new capabilities that were previously thought impossible.
- We provide exposure to higher learning opportunities so that you can work on complex and cutting
edge technology like React, React Native, Flutter, NodeJS, Python, Go, Svelte, WebAssembly.
Strong expertise in blockchain and crypto technology and working with the networks like Hedera
Hashgraph, Tezos, BlockApps, Algorand, Cardano.
- We maintain high end transparency with clients and employees as Visibility unlocks Efficiency and
trust unlocks Visibility.
- Company is backed by two technology Co-founders, well-versed with consumer applications and
their work has been downloaded millions of times and have led teams in leadership positions in
companies like Samsung, Purplle, Loylty Rewardz.


Benefits :

> Health Insurance
> Fast growth and more visibility into the company
> Experience to work on the latest technology
> Competitive Learning Environment with supportive co-workers
> Employee friendly HR Policies
> Paid leaves up to certain limits
> Competitive salaries & Bonuses
> Liberal working atmosphere
> Get mentored by the best in the industry


Schedule:

Day Shift/Flexible working hours
Monday to Friday
Read more
Accoty
at Accoty
1 recruiter
Gaurav Verma
Posted by Gaurav Verma
Remote only
3 - 5 yrs
₹6L - ₹8L / yr
skill iconPython
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+8 more

Responsibilities

  • Work with stakeholders and fellow developers.
  • Design and implement Python code using the Django framework.
  • Identify and fix bottlenecks that may arise from inefficient code.
  • Identify and fix software bugs.
  • Create a wide variety of unit tests to verify the functionality of the software.
  • Manage the security of the platform.
  • Write detailed documentation around the code.
  • Knowledge of front end languages.
  • Create and maintain the application's architecture
  • Write code that is reusable, testable, and efficient
  • Create and implement applications that are low-latency, high-availability, and performant
  • Integration of front-end developer-created user-facing components with server-side logic
  • Security and data protection implementation
  • Data storage solution integration

Skills

  • Able to use Postman, JIRA or similar tools
  • Python expert with an understanding of at least one Python web framework, such as Django, Flask, or others
  • Working knowledge of several ORM (Object Relational Mapper) libraries
  • Capable of combining many data sources and databases into a single system
  • Knowledge of Python's threading constraints and multi-process architecture
  • Solid knowledge of server-side templating languages such as Jinja 2, Mako, etc.
  • Fundamental knowledge of front-end technologies such as JavaScript, HTML5, and CSS3
  • Knowledge of accessibility and security regulations
  • Managing and maintaining AWS
  • Able to create RESTful APIs
  • Able to integrate third-party APIs
  • Familiarity with user authentication
  • Authorisation across numerous systems, servers, and settings
  • Knowledge of the core design ideas underlying a scalable application
  • Experience with Python event-driven programming
  • Understanding the distinctions between various delivery platforms, such as mobile vs desktop, and optimising output to meet the individual platform
  • Capable of developing database schemas to represent and support business operations
  • Excellent unit testing and debugging abilities
  • Thorough knowledge of code versioning systems such as Git, Mercurial, or SVN
  • Able to deploy the app on client cloud as well.

Requirements:

  • Bachelor’s/Master in computer science
  • 3-5 years of work experience
  • Excellent problem-solving skills
  • Able to work in a fast, unstructured environment
  • Excellent communication and collaboration skills
  • Must have access to FTTH internet connection
Read more
Quantive (Formerly Gtmhub)
Vranda Baheti
Posted by Vranda Baheti
Indore
1 - 2 yrs
₹4L - ₹8L / yr
User Experience (UX) Design
User Interface (UI) Design
Sketch
skill iconAdobe XD
Illustration
+1 more

About Us

http://cliff.ai/">Cliff.ai is the world's leading business observability platform. It is a complete paradigm shift in the way companies monitor their business processes.

We are a small team - based across London and Indore - with a big vision and are growing rapidly. We’re a Techstars company, and are backed by some of London’s biggest VCs. We have been awarded UK’s ‘Startup of the Year’ and also featured by Forbes as a startup 'set to blaze a trail'.

http://Cliff.ai">Cliff.ai recently got acquired by https://gtmhub.com/">Gtmhub- the world’s best business
orchestration platform, powered by the proven OKR methodology. They support over 500,000 users across 75 countries and 1,000+ organizations including Red Hat, Adobe, Societe Generale, and TomTom.

We are looking for

A smart, multi-talented product designer who has an eye for design and possesses a “design thinking” mindset in putting yourself in the users’ shoes. The ideal candidate will be highly creative and strongly self-motivated; has deep experience in making a product more intuitive and in reducing the steps needed for users to achieve desired tasks.

They will work closely with engineering, product, and business folks to find elegant but practical solutions to design challenges. They'll provide and own the visual direction.

Your work includes

  • Own the design cycle - right from user research, problem discovery, sketching and wire-framing, building flows and interactions, to creating pixel-perfect screens, testing prototypes and working with developers.
  • Collaborate with product and engineering teams on product iterations to enhance the overall product experience. Together, you’ll solve problems and come up with solutions that delight our customers.
  • Establish and promote design guidelines, best practices and standards.
  • Research functionalities and features needed for the app and come up with ideas that can improve the product.
  • Conduct competitor UX design analysis, and keep abreast of competitor products and industry design trends.
  • Rapidly produce multiple concepts and prototypes; knowing when to apply pixel-perfect attention to detail, and when to make low-fi sketches and prototypes and familiarity with SAAS platform.
  • Modify and revise existing designs to meet customer expectations.

 

Skills/Requirements

  • Expert with design tools (e.g. Sketch, Adobe XD, Figma) to design wireframes and high-fidelity interactive prototypes.
  • Can create pixel-perfect visual designs with a strong sense of aesthetics, especially font pairings, typography and spacing.
  • Has stronghold on common UX patterns, UI -Patterns.
  • Aware of emerging technological trends and understand their impact on design.
  • You can work independently and have high ownership of getting things done. You take the lead in discovering problems and execution.
  • (Bonus) Have a good understanding of data visualization techniques/tools. (How to show data effectively to the customers).
  • (Bonus) Are good with animation, micro-interactions, illustration and or just a curious mind for new tools and platforms.
  • (Bonus) Have experience of working in a startup environment where things are fast-paced and priorities are ever-changing.

What you can expect

  • Attractive pay and bonus scheme.
  • Lunch is on us!
  • Quarterly bonus opportunities (up to 25%)
  • Employer-covered supplementary medical insurance
  • Access to 5,000+ Udemy courses for ongoing learning and development
  • Stock option opportunities
  • MAC or PC of your choice
  • Flexible working hours and leave policy.
  • A truly flexible, trust-based, performance-driven work culture.
  • A young and passionate team building elegant products with intricate technology for the future of retail and e-commerce. Our average age is below 25!

 

It’s important to us

  • That you relocate to Indore.
Read more
Quantela
at Quantela
3 recruiters
Sai Singh
Posted by Sai Singh
Hyderabad
5 - 8 yrs
₹6L - ₹12L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+11 more
  • Java,Jdbc,J2ee,Ajax,jquery,Spring,Hibernate, Restful Web Services, JAVASCRIPT, HTML, CSS 
  • T-SQL and PL/SQL 
  • Strong experience in core java 
  • Experience in OOAD frameworks, Spring Integration, Hibernate, JSP, Tiles, Applets, Servlets 
  • Extensive development experience with PL/PGSQL (PostgreSQL) 
  • Good experience in code optimization, performance tuning, debugging 
  • Web/App server: TOMCAT/JBOSS/WAS 
  • Knowledge of OOPS concepts, SDLC, and design patterns 
  • Good Analytical ability and Problem Solving Skills 
  • Good communication skills in both written and verbal 
  • Java Certification will be an added advantage 
Read more
Digital Transformation & IT Services Company
Digital Transformation & IT Services Company
Agency job
via Jobdost by Ankitha Vyas
Chennai
4 - 7 yrs
₹13L - ₹15L / yr
Wordpress
Content Management System (CMS)
skill iconHTML/CSS

Position : Wordpress Developer

Work Location :
Chennai

Work Experience : 4 to 7 Years

Job requirement:

  • To create, improve, and maintain our custom developed Wordpress applications and Wordpress websites.
  • Making highly customized websites with own developed themes and plugins.
  • To understand design guidelines and develop accordingly with pixel perfect accuracy, by integrating HTML/CSS responsive designs as a Wordpress theme.
  • To improve performance of the website loading time.
  • Should have experience in Ecommerce
  • Should have experience in developing media site
Read more
Cognicept
at Cognicept
1 video
1 recruiter
Abhinandan Karki
Posted by Abhinandan Karki
Bengaluru (Bangalore)
0 - 5 yrs
₹1L - ₹3L / yr
Technical support
Customer Support
Customer Service
Job Description:
Robot Pilots are the front line of Cognicept’s operation and play an essential role in
the successful deployment of robotics: remotely resolving, analyzing, and reporting
robot errors. Providing a quick resolution to the client robot system is the highest
priority. These interventions ultimately lead to better performance and more
sophisticated applications of robotic systems. Robot Pilots use an error reporting
management system to document their interventions and findings into a
centralized database which is then used by the client, other Cognicept Robot Pilots,
and our engineers located worldwide.

Key responsibilities :
- Incident Management for robot issues within SLA.
- Error handling and resolution.
- Remote monitoring and robot operations.
- Help robots find their way by remotely correcting their internal “GPS” location and
driving/controlling the robot through unpredictable situations using
Cognicept’s propriety intervention system (it’s like a video game).
- Identify and report errors/failures/bugs, and suggest improvements to
processes and technologies.
- Manage inbound and outbound calls in a timely manner.
- Follow communication “scripts” and standard operating procedures.
- Identify customers’ needs, clarify information, research every issue and
provide solutions and/or alternatives.
- Keep detailed records of all interventions in the Cognicept database.
- Track personal/team qualitative and quantitative KPIs with your line manager.
- Take part in training and other learning opportunities to expand knowledge of
Cognicept and the position.

Skills/Qualifications:
- Experience with incident management, customer service and tech support preferred.
- Solid oral and written communication skills.
- Solid reading comprehension and listening skills.
- A keen eye for detail.
- Ability to work both independently and as part of a team.
- Excellent time to task management.
- Owns a laptop that runs Google Chrome and has a headset. (BYOD culture)
- Owns a functional smartphone with a data plan and an Indian phone number.
- Able to work in 24/7 shift with 6 days of working.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos