Cutshort logo
For Employers
A fast growing Big Data company  logo
AWS Glue Developer
A fast growing Big Data company
AWS Glue Developer

AWS Glue Developer at A fast growing Big Data company · Noida, Bengaluru (Bangalore), Chennai, Hyderabad · 6 - 8 years · ₹10L - ₹15L / yr · Posted 27 Oct 2023

Careerconnects's logo

AWS Glue Developer

at A fast growing Big Data company

Agency job
6 - 8 yrs
₹10L - ₹15L / yr
Noida, Bengaluru (Bangalore), Chennai, Hyderabad
Skills
AWS Glue
SQL
skill iconPython
PySpark
Data engineering
Big Data
Hadoop
Spark
DMS
Data integration
Data Ops

AWS Glue Developer 

Work Experience: 6 to 8 Years

Work Location:  Noida, Bangalore, Chennai & Hyderabad

Must Have Skills: AWS Glue, DMS, SQL, Python, PySpark, Data integrations and Data Ops, 

Job Reference ID:BT/F21/IND


Job Description:

Design, build and configure applications to meet business process and application requirements.


Responsibilities:

7 years of work experience with ETL, Data Modelling, and Data Architecture Proficient in ETL optimization, designing, coding, and tuning big data processes using Pyspark Extensive experience to build data platforms on AWS using core AWS services Step function, EMR, Lambda, Glue and Athena, Redshift, Postgres, RDS etc and design/develop data engineering solutions. Orchestrate using Airflow.


Technical Experience:

Hands-on experience on developing Data platform and its components Data Lake, cloud Datawarehouse, APIs, Batch and streaming data pipeline Experience with building data pipelines and applications to stream and process large datasets at low latencies.


➢ Enhancements, new development, defect resolution and production support of Big data ETL development using AWS native services.

➢ Create data pipeline architecture by designing and implementing data ingestion solutions.

➢ Integrate data sets using AWS services such as Glue, Lambda functions/ Airflow.

➢ Design and optimize data models on AWS Cloud using AWS data stores such as Redshift, RDS, S3, Athena.

➢ Author ETL processes using Python, Pyspark.

➢ Build Redshift Spectrum direct transformations and data modelling using data in S3.

➢ ETL process monitoring using CloudWatch events.

➢ You will be working in collaboration with other teams. Good communication must.

➢ Must have experience in using AWS services API, AWS CLI and SDK


Professional Attributes:

➢ Experience operating very large data warehouses or data lakes Expert-level skills in writing and optimizing SQL Extensive, real-world experience designing technology components for enterprise solutions and defining solution architectures and reference architectures with a focus on cloud technology.

➢ Must have 6+ years of big data ETL experience using Python, S3, Lambda, Dynamo DB, Athena, Glue in AWS environment.

➢ Expertise in S3, RDS, Redshift, Kinesis, EC2 clusters highly desired.


Qualification:

➢ Degree in Computer Science, Computer Engineering or equivalent.


Salary: Commensurate with experience and demonstrated competence

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

Similar jobs (10)

VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
7 - 13 yrs
₹10L - ₹24L / yr
skill iconPython
PySpark
Oracle
PL/SQL
Google Cloud Platform (GCP)
+2 more

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

  • Strong expertise in Data Modeling, Data Design & Modernization
  • Primary skills: PySpark, Oracle SQL/PLSQL
  • Secondary skills: Python, ETL & Data Pipelines
  • Experience with Kafka and Hadoop
  • Exposure to AWS / Azure / GCP
  • Good knowledge of Git and JIRA

Roles & Responsibilities:

  • Design, develop, and modernize scalable data models and data architecture.
  • Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
  • Build and maintain robust ETL workflows and data pipelines.
  • Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
  • Perform data transformation, optimization, and performance tuning.
  • Collaborate with technical teams on data design, development, testing, and deployment.


Read more
Wissen Technology
at Wissen Technology
4 recruiters
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
skill iconAmazon Web Services (AWS)
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹7L - ₹18L / yr
skill iconPython
PySpark
SQL

🚨 WE ARE HIRING – SENIOR DATA ENGINEER | BANGALORE 🚨


Looking for experienced Senior Data Engineers with strong expertise in PySpark, Oracle SQL/PLSQL, and Data Modeling!


🔹 Role: Senior Data Engineer

🔹 Experience: 7+ Years

🔹 Location: Bangalore

🔹 CTC: Up to 26 LPA

🔹 Notice Period: Immediate to 10 Days Preferred


💻 Mandatory Skills


✅ PySpark

✅ Oracle SQL / PL/SQL

✅ Data Modeling & Design / Modernization

✅ Python

✅ ETL

✅ Data Pipelines


⚙️ Good to Have / Ecosystem Skills


✅ Kafka

✅ Hadoop

✅ AWS / Azure / GCP

✅ Git

✅ JIRA


📌 Key Responsibilities


• Develop and maintain scalable data pipelines using PySpark

• Work extensively with Oracle SQL/PLSQL for data processing and transformation

• Design and implement data models and data architecture

• Work on data design and modernization initiatives

• Develop and optimize ETL processes and data pipelines

• Handle large volumes of data using PySpark and Python

• Work with technologies such as Kafka, Hadoop, and Cloud platforms

• Collaborate with cross-functional teams to deliver scalable data solutions

• Use Git and JIRA for version control and project tracking


📩 Interested candidates can share their updated CV along with:


Total Experience:

Relevant PySpark Experience:

Relevant Oracle SQL/PLSQL Experience:

Data Modeling Experience:

Current Location:

Notice Period:

Current CTC:

Expected CTC:


#Hiring #DataEngineer #SeniorDataEngineer #PySpark #Oracle #PLSQL #DataModeling #Python #ETL #DataPipelines #Kafka #Hadoop #AWS #Azure #GCP #BangaloreJobs #ITJobs #TechJobs #ImmediateJoiners

Read more
Proximity Works
at Proximity Works
1 video
5 recruiters
Tushar Vaghela
Posted by Tushar Vaghela
Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconPython
skill iconScala
Apache Spark
Apache Kafka
databricks
+1 more

Description


We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.



Key Responsibilities

  • Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
  • Build and optimize distributed data applications using Apache Spark and Python Scala.
  • Develop reliable, high-performance data pipelines for batch and streaming workloads.
  • Design and manage data workflows using Apache Airflow.
  • Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
  • Work with large datasets to ensure data quality, consistency, reliability, and performance.
  • Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
  • Optimize data workflows for scalability, reliability, performance, and cost efficiency.
  • Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.



Requirements

Candidates who demonstrate:

  • 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
  • Strong hands-on experience with Apache Spark and Scala.
  • Experience designing, building, and maintaining large-scale ETL pipelines.
  • Strong hands-on experience with AWS, particularly Amazon S3.
  • Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
  • Strong SQL skills and a solid understanding of distributed data processing concepts.
  • Experience working with batch and/or streaming data pipelines.
  • Excellent debugging, problem-solving, and performance optimization skills.
  • Strong communication and collaboration skills.


Good to Have

  • Experience with Databricks and the broader Databricks data platform.
  • Familiarity with streaming technologies such as Apache Kafka.
  • Experience working on large-scale data platforms handling high-volume data workloads.
  • Exposure to additional AWS data services and cloud-native data architectures.
Read more
VY SYSTEMS PRIVATE LIMITED
Hyderabad, Bengaluru (Bangalore)
5 - 9 yrs
₹9L - ₹20L / yr
PySpark
SQL
skill iconPython
ETL

Data Engineer Hiring Post


🚨 Hiring: Data Engineer | PySpark + Python + SQL

We are looking for experienced Data Engineers to join our team!

🔹 Experience: 5 to 9 Years

🔹 Locations: Bangalore / Hyderabad

🔹 Interview Process:

• 1st Round – Virtual

• 2nd Round – Face-to-Face (Karat Test)

🔑 Key Skills:

✅ PySpark

✅ SQL

✅ Python

✅ ETL

📩 Interested candidates can share their updated resume.

#Hiring #DataEngineer #PySpark #Python #SQL #ETL #BangaloreJobs #HyderabadJobs #TechHiring #ImmediateHiring

Read more
Wissen Technology
at Wissen Technology
4 recruiters
Bharanidharan K
Posted by Bharanidharan K
Bengaluru (Bangalore), Mumbai
6 - 12 yrs
Best in industry
databricks
PySpark
skill iconPython
SQL

Company: Wissen Technology

Position: Databricks Engineer

Experience: 6-10 Years

Location: Bengaluru/Mumbai

Employment Type: Full-time


About Wissen Technology

Wissen Technology is a global technology services company focused on delivering innovative software engineering, data, and technology solutions to leading enterprises. The company works with clients across industries to build scalable, high-performance technology platforms and solve complex business and technology challenges.

With a strong focus on engineering excellence, innovation, and collaboration, Wissen Technology brings together skilled technology professionals across areas such as software engineering, data engineering, cloud, analytics, and digital transformation.

At Wissen Technology, employees have the opportunity to work on challenging technology projects, collaborate with experienced engineering teams, and contribute to solutions that create measurable business impact.

Key Responsibilities

  • Design, develop, and maintain scalable data processing applications using Python, PySpark, and Spark.
  • Develop and optimize data pipelines and workflows on Databricks.
  • Collaborate with data engineers, data scientists, business stakeholders, and other technical teams to understand requirements and deliver high-quality solutions.
  • Ensure data integrity, quality, performance, and reliability across data processing pipelines.
  • Write clean, maintainable, scalable, and efficient code following established coding standards and best practices.
  • Perform data analysis and implement appropriate data validation and quality checks.
  • Monitor, troubleshoot, and optimize performance issues across data workflows and pipelines.
  • Work with relational databases and develop efficient SQL queries for data extraction and transformation.
  • Participate in code reviews, testing, deployment, and continuous improvement of data engineering solutions.
  • Use Git/version control and follow established software development and deployment practices.

Required Skills & Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field.
  • Proven experience as a Databricks Developer, Data Engineer, or similar role.
  • Strong hands-on expertise in Apache Spark and PySpark.
  • Strong programming skills in Python; experience with Scala is an advantage.
  • Strong proficiency in SQL and hands-on experience with relational databases.
  • Practical experience developing and optimizing data pipelines and data processing applications.
  • Familiarity with Git and version control systems.
  • Strong understanding of data engineering concepts, data transformation, and data validation.
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Read more
It is an Product Based Company(Domain- EV Charging)
It is an Product Based Company(Domain- EV Charging)
Agency job
via Unique Occupational by Mantasha Naaz
icon

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

Bengaluru (Bangalore)
3 - 5 yrs
₹13L - ₹15L / yr
skill iconAmazon Web Services (AWS)
skill iconPython
PySpark
SQL
ETL
+2 more

Data Engineer

Location: Bengaluru, India (Hybrid)

Employment Type: Full-time

Experience: 3-5 years



Role Overview  

What We’re Looking For:

  • Bachelor’s degree in Computer Science/Engineering or equivalent experience required.
  • Experience designing and shipping cloud services products.
  • Experience driving and managing technical and architectural dependencies on AWS Cloud.
  • A firm understanding of system architecture, cloud computing, PaaS/SaaS design principles, S3, DynamoDB, RDS mandatory.
  • Experience in building or maintaining ETL processes and tools, i.e., AWS Glue or any open-source tool.
  • Proven system-level design contribution to a current “Live” (in production / under daily high load) multi-region SaaS or PaaS offering.
  • Proven experience with S3, DynamoDB, SQL, and AWS RDS services.
  • Proficiency in programming languages such as Python.
  • Strong analytical and problem-solving skills.

Required Skills & Experience

  • Experience with Python, SQL, and data visualization/exploration tools.
  • Familiarity with the AWS ecosystem, specifically S3, DynamoDB, and RDS.
  • Communication skills, especially for explaining technical concepts to nontechnical business leaders.
  • Ability to work on a dynamic, research-oriented team that has concurrent projects.
  • Experience in AWS cost optimization (Savings Plans, Reserved Instances, Spot Instances) and governance frameworks.
  • Experience developing solutions using infrastructure orchestration tools (SSM, automation account, Ansible, etc.).
  • Excellent leadership, stakeholder management, and communication skills.

 

What We Offer

  • Work with some of the brightest minds in the emerging EV industry.
  • Make a tangible impact in reducing carbon emissions and enabling sustainable energy.
  • Freedom to suggest, implement, and innovate on systems, processes, and technologies.
  • Daily ownership in a high-growth, challenging environment.
  • Flexible work environment with hybrid schedules and virtualization options.
  • Competitive pay and benefits including health coverage, innovative PTO program, and performance bonuses.


Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹18L - ₹28L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
Bengaluru (Bangalore)
6 - 10 yrs
₹2L - ₹22L / yr
ETL Development
Hadoop
PySpark
skill iconPython
SQL
+3 more

Job Description

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, PySpark, Python, and SQL. The candidate should have hands-on experience in developing data pipelines, processing and transforming large datasets, and working with data warehousing and big data technologies.

Key Responsibilities

  • Design, develop, and maintain ETL processes and data pipelines.
  • Work with Hadoop and PySpark to process and transform large volumes of data.
  • Develop and optimize Python scripts for data processing and automation.
  • Write complex SQL queries for data extraction, transformation, and validation.
  • Perform data cleansing, integration, transformation, and validation.
  • Work with data warehousing concepts and large-scale data processing systems.
  • Optimize ETL workflows for performance, scalability, and reliability.
  • Troubleshoot data pipeline failures and resolve data quality issues.
  • Collaborate with data engineers, analysts, and other technical teams.
  • Follow data governance, quality, and development best practices.

Required Skills

  • Strong experience in ETL Development – Mandatory
  • Hands-on experience with Hadoop – Mandatory
  • Strong experience in PySpark – Mandatory
  • Good programming skills in Python – Mandatory
  • Strong knowledge of SQL – Mandatory
  • Experience in Data Processing and Transformation – Mandatory
  • Knowledge of Data Warehousing – Mandatory
  • Experience with Big Data Technologies – Mandatory

Opportunity Details

Role: ETL Developer – Hadoop & PySpark

Experience: 6–10 Years

Location: Bangalore

Mandatory Skills

ETL Development | Hadoop | PySpark | Python | SQL | Data Processing & Transformation | Data Warehousing | Big Data Technologies

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos