Cutshort logo
For Employers
Agiletech Info Solutions pvt ltd logo
Bigdata Technical Support Engineers
Bigdata Technical Support Engineers

Bigdata Technical Support Engineers at Agiletech Info Solutions pvt ltd · Chennai · 2 - 5 years · ₹3L - ₹14L / yr · Bootstrapped · Posted 29 Oct 2022

Agiletech Info Solutions pvt ltd's logo

Bigdata Technical Support Engineers

Suganiya SG's profile picture
Posted by Suganiya SG
2 - 5 yrs
₹3L - ₹14L / yr
Chennai
Skills
skill iconPython
SQL
Linux/Unix

Technical Skills Required – Mandatory:

 

- Cloud Technologies – AWS OR Bigdata (Basic Level)

- Python (Highly Experience Level)

- Databases – SQL (Highly Experience Level)

- Operating Systems – Unix (Highly Experience Level)

 

Strong knowledge in writing complex SQL queries and Knowledge of Performance Tuning

Excellent working knowledge of production support role and Strong debug/troubleshooting skills

Provide 24×7 operational support to all production practices on holidays and weekends.

Hands-on experience in production support for data engineering processes, root cause analysis, and identifying opportunities to improve existing processes.

Roles and Responsibilities:

Set up and optimize the existing integration, monitoring and alerting processes.

Working knowledge of ETL/ELT in Hadoop, Spark and MPP databases is required.

Effectively collaborate with the partners (SMEs, DBA, and Business users) to ensure the reliability of the Data systems.

 

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Agiletech Info Solutions pvt ltd

Founded :
2016
Type :
Products & Services
Size :
20-100
Stage :
Bootstrapped

About

At Agiletech Info Solutions, we provide consulting, technology and business process outsourcing solutions to organizations. We strongly believe in customized solutions for each client as every business problem is unique. Our key strength lies in our ability to transform complex business challenges to opportunities for growth and thereby position our customers to become market leaders in their respective areas. Key focus areas Salesforce customizations & support NetSuite customizations & support Cloud Systems Integrations Systems development & management Mobile App Solutions Business Intelligence With offices in India and the USA, we are close to our markets as well as to talent pools. Our team brings decades of experience in both technology and project management- so you can be confident that your work is in safe hands, and will be completed on time and within budget. We are a young and ambitious organization with a clear vision of where we want to be and how we can get there. For this journey, we are looking to hire people who are both talented and ambitious. If you are keen to create solutions of the future rather than simply supporting those of the past, we invite you to consider us to be your next workplace. We promise you an environment that values mutual respect, provides opportunities to work on cutting edge platforms and enables personal and professional growth through learning and performance-linked rewards. And you get all this in a friendly, non-hierarchical, merit-based organization that values not just who you are today- but helps you become who you can be tomorrow. Come, get in touch. For additional information please visit: http://www.agiletechinfosolutions.com/
Read more

Company social profiles

linkedin

Similar jobs (10)

VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
6 - 10 yrs
₹5L - ₹20L / yr
Hadoop
PySpark

Dear Candidate,

Thanks for showing interest in the opportunity!!!

As discussed, we have an opening for ETL Developer – Hadoop & PySpark with Mphasis for the Bangalore location – Permanent.


Job Description:

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, and PySpark. The candidate should have hands-on experience in data processing, building and maintaining ETL pipelines, data transformation, and handling large datasets using Big Data technologies.

Primary & Mandatory Skills:

  • ETL Development
  • Hadoop / HDFS
  • PySpark / Apache Spark
  • Data Extraction, Transformation & Loading
  • SQL and Data Processing

Good to Have:

  • Hive / Spark SQL
  • Data Pipeline Development
  • Big Data Processing
  • Python Programming

Company: Mphasis

Role: ETL Developer – Hadoop & PySpark

Experience: As per requirement

Location: Bangalore

Employment Type: Permanent

Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Akshay Patil
Posted by Akshay Patil
Remote, Pune
3 - 8 yrs
₹14L - ₹30L / yr
Data Platform Engineer
skill iconJava
skill iconPython
SQL
Data engineering
+13 more

Job Title : Data Platform Engineer (SDE 2 / SDE 3)

Experience : 3 to 8 Years (SDE2 : 3 to 5 Years | SDE3 : 5.5 to 8 Years)

Location : Remote (Contract) → Pune (Post Conversion)

Employment Type : Contract-to-Hire (3 Months)


Mandatory Skills :

Java / Python / Go, SQL, Data Engineering, ETL / ELT, Apache Airflow, Apache Spark / Flink, Kafka, AWS/GCP/Azure, Distributed Systems, API Development, Docker, Kubernetes, CI/CD, System Design


Role Overview :

We are looking for a Data Platform Engineer with strong backend engineering expertise to build scalable, high-performance data platforms and distributed systems. The ideal candidate should have hands-on experience in developing production-grade backend applications along with designing and maintaining modern data pipelines.


Key Responsibilities :

  • Build and maintain scalable ETL/ELT and data processing pipelines.
  • Develop backend services and APIs using Java (preferred), Python, or Go.
  • Design batch and real-time data pipelines using Spark, Flink, Kafka, and Airflow.
  • Optimize SQL queries, data models, and distributed data systems.
  • Work with cloud platforms (AWS, GCP, or Azure) and container technologies (Docker, Kubernetes).
  • Implement CI/CD, monitoring, logging, and performance optimization.
  • Collaborate with product and engineering teams on scalable system design and architecture.


Required Qualifications :

  • SDE 2 : 3 to 5 years of Backend + Data Engineering experience.
  • SDE 3 : 5.5 to 8 years of Backend + Data Engineering experience.
  • Strong coding skills in Java (preferred), Python, or Go.
  • Excellent SQL and data modeling knowledge.
  • Hands-on experience with Airflow, Apache Spark / Apache Flink, or similar technologies.
  • Experience building scalable backend services and APIs.
  • Good understanding of distributed systems, system design. and scalable architecture.
  • Experience with cloud platforms (AWS, Azure, or GCP).
  • Hands-on experience with Docker and Kubernetes.
  • Strong understanding of CI/CD pipelines.
  • Excellent problem-solving and debugging skills.


Good to Have :

  • Experience with Snowflake, BigQuery, or Redshift.
  • Understanding of Kafka, Kinesis, or Pub/Sub
  • Performance optimization of large-scale distributed systems
  • FinTech or high-scale distributed systems experience.
  • Knowledge of data governance, security, and compliance.


Preferred Candidate Profile :

  • Strong Backend + Data Engineering experience
  • Experience building scalable production systems
  • Strong ownership mindset
  • Good system design knowledge
  • Experience processing millions of events using Kafka/Spark
  • Built APIs supporting data infrastructure
  • Production engineering experience


Interview Process :

  1. Take-home Coding Assignment (48 Hours)
  2. Leadership & Strategy Round (1 Hour)
  3. Technical Depth – Data Engineering & Performance (1 Hour)
  4. Culture & Values Fit (30 Minutes)
Read more
Bengaluru (Bangalore)
6 - 10 yrs
₹2L - ₹22L / yr
ETL Development
Hadoop
PySpark
skill iconPython
SQL
+3 more

Job Description

We are looking for an experienced ETL Developer with strong expertise in ETL development, Hadoop, PySpark, Python, and SQL. The candidate should have hands-on experience in developing data pipelines, processing and transforming large datasets, and working with data warehousing and big data technologies.

Key Responsibilities

  • Design, develop, and maintain ETL processes and data pipelines.
  • Work with Hadoop and PySpark to process and transform large volumes of data.
  • Develop and optimize Python scripts for data processing and automation.
  • Write complex SQL queries for data extraction, transformation, and validation.
  • Perform data cleansing, integration, transformation, and validation.
  • Work with data warehousing concepts and large-scale data processing systems.
  • Optimize ETL workflows for performance, scalability, and reliability.
  • Troubleshoot data pipeline failures and resolve data quality issues.
  • Collaborate with data engineers, analysts, and other technical teams.
  • Follow data governance, quality, and development best practices.

Required Skills

  • Strong experience in ETL Development – Mandatory
  • Hands-on experience with Hadoop – Mandatory
  • Strong experience in PySpark – Mandatory
  • Good programming skills in Python – Mandatory
  • Strong knowledge of SQL – Mandatory
  • Experience in Data Processing and Transformation – Mandatory
  • Knowledge of Data Warehousing – Mandatory
  • Experience with Big Data Technologies – Mandatory

Opportunity Details

Role: ETL Developer – Hadoop & PySpark

Experience: 6–10 Years

Location: Bangalore

Mandatory Skills

ETL Development | Hadoop | PySpark | Python | SQL | Data Processing & Transformation | Data Warehousing | Big Data Technologies

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
6 - 10 yrs
₹5L - ₹30L / yr
ETL
ETL Development
skill iconPython
PySpark

Hiring: ETL Developer – Hadoop & PySpark

Location: Bangalore

Experience: 6–10 Years

Budget: 25–30 LPA

Work Mode: Weekdays

Job Description

We are looking for an experienced ETL Developer with strong expertise in Hadoop, PySpark, Python, and SQL to design, develop, and optimize data processing and transformation solutions. The ideal candidate should have hands-on experience working with big data technologies, building scalable ETL pipelines, and managing data for data warehousing and analytics.

Key Responsibilities

  • Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
  • Develop data transformation workflows using PySpark and Python.
  • Work with Hadoop and other big data technologies to process and manage large datasets.
  • Write complex SQL queries for data extraction, transformation, validation, and analysis.
  • Implement data cleansing, data quality checks, and data validation processes.
  • Develop and optimize data integration workflows for data warehousing solutions.
  • Troubleshoot ETL failures, performance issues, and data discrepancies.
  • Optimize PySpark jobs and SQL queries for performance and scalability.
  • Collaborate with data engineers, architects, analysts, and other stakeholders to deliver reliable data solutions.
  • Ensure data accuracy, consistency, and adherence to established data governance standards.

Mandatory Skills

  • Strong hands-on experience in ETL development.
  • Good experience with Hadoop and big data technologies.
  • Proficiency in PySpark and Python programming.
  • Strong SQL skills, including complex queries and data manipulation.
  • Experience in data processing, data transformation, and data integration.
  • Understanding of data warehousing concepts and architecture.
  • Experience in developing, debugging, and optimizing ETL pipelines.

Required Experience

  • 6–10 years of relevant experience in ETL development and data engineering.
  • Practical experience handling large datasets using Hadoop and PySpark.
  • Strong analytical, problem-solving, and troubleshooting skills.
  • Ability to work independently and collaborate effectively within a team.


Interested candidates can share their updated resumes along with current CTC, expected CTC, notice period, and total relevant experience.

Read more
VY SYSTEMS PRIVATE LIMITED
Actively reviewing applications
Dharshini A
Posted by Dharshini A
Bengaluru (Bangalore)
6 - 12 yrs
₹5L - ₹20L / yr
Amazon EMR
skill iconPython
skill iconScala

We are hiring experienced Data Engineers for a permanent opportunity in Bangalore.

Job Description

Role: Data Engineer

Location: Bangalore

Experience: 6+ Years

Key Responsibilities:

  • Design, develop, and maintain scalable data processing pipelines using Amazon EMR.
  • Develop data engineering solutions using Python and Scala.
  • Process and transform large volumes of structured and unstructured data.
  • Build and optimize distributed data processing workflows for performance and scalability.
  • Work with big data technologies and cloud-based data processing environments.
  • Perform data integration, validation, transformation, and quality checks.
  • Troubleshoot data pipeline issues and optimize processing performance.
  • Collaborate with data architects, analysts, and development teams to deliver reliable data solutions.

Required Skills:

  • Strong hands-on experience with Amazon EMR.
  • Proficiency in Python and Scala.
  • Experience in big data processing and data pipeline development.
  • Good understanding of distributed computing and data transformation techniques.
  • Experience in performance tuning and troubleshooting data processing jobs.
  • Strong analytical, problem-solving, and communication skills.


Read more
MNC
MNC
Agency job
via VY SYSTEMS PRIVATE LIMITED by Akilandeswari Panneerselvam
Bengaluru (Bangalore)
6 - 9 yrs
₹8L - ₹15L / yr
ETL
Informatica
Hadoop
Apache Spark
Snow flake schema

Position: Backup Data ETL Developer

Experience: 6–9 Years

Location:Mumbai

Employment Type: Full-time

Job Description:

We are looking for a Backup Data ETL Developer with 6–9 years of experience in designing, developing, and supporting data extraction, transformation, and loading (ETL) processes.

The candidate should have strong hands-on experience with Hadoop, Spark, Informatica, and Snowflake, along with expertise in large-scale data processing and data integration technologies.

Key Skills:

Hadoop

Spark

Informatica

Snowflake

ETL Development

Data Integration

Data Transformation

Large-Scale Data Processing

ETL Workflows and Data Pipelines

Troubleshooting and Problem-Solving

Strong analytical and collaboration skills

Read more
Staffnixcom
Actively reviewing applications
Mayank Choudhary
Posted by Mayank Choudhary
Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
skill iconAmazon Web Services (AWS)
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
Staffnixcom
Actively reviewing applications
Mayank Choudhary
Posted by Mayank Choudhary
Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
Data engineering
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
NeoGenCode Technologies Pvt Ltd
Actively reviewing applications
Akshay Patil
Posted by Akshay Patil
Gurugram
5 - 10 yrs
₹6L - ₹16L / yr
skill iconAmazon Web Services (AWS)
Data engineering
Data Lake Architecture
Amazon S3
AWS Glue
+15 more

🚀 Job Title : Data Engineer – AWS, PySpark & Airflow

Experience : 5+ Years

Industry : Health Insurance / BFSI

Location : Sector 43, Gurugram, Haryana

Work Mode : Work From Office (5 Days a Week)

Employment Type : Full-Time


Role Overview :

We are looking for an experienced Data Engineer with strong hands-on expertise in AWS Data Engineering, Data Lake Architecture, Python, SQL, PySpark, and Apache Airflow.

The candidate will be responsible for designing, developing, and maintaining scalable, reliable, and high-performance data pipelines using AWS cloud technologies. The role involves building end-to-end ETL / ELT workflows, implementing data transformation and processing solutions, optimizing pipeline performance, and ensuring the reliability of production data systems.


Mandatory Skills :

AWS Data Engineering | Data Lake Architecture | Amazon S3 | AWS Glue | Amazon EMR | Athena | Redshift | Python | SQL | PySpark | Apache Spark | Apache Airflow | ETL/ELT | PostgreSQL | Data Modelling | Pipeline Optimization | Production Support | Root Cause Analysis


Key Responsibilities :

  • Design, develop, and maintain end-to-end data pipelines for data ingestion, staging, transformation, curation, and consumption.
  • Build and manage AWS-based data lake solutions using Amazon S3, AWS Glue, Amazon EMR, Athena, and Redshift.
  • Develop, maintain, and optimize ETL / ELT pipelines using Python, SQL, Apache Spark, and PySpark.
  • Implement and manage workflow orchestration using Apache Airflow, including scheduling, dependency management, retries, monitoring, and failure handling.
  • Integrate data from multiple structured and semi-structured sources.
  • Design and maintain data models, dimensional models, and analytical data marts.
  • Work with relational databases, including PostgreSQL and Amazon RDS.
  • Optimize Spark jobs, SQL queries, data transformations, and cloud resource utilization.
  • Implement data quality checks, validation rules, and error-handling mechanisms.
  • Monitor production data pipelines, troubleshoot failures, and perform root cause analysis (RCA).
  • Ensure pipeline reliability, scalability, performance, and compliance with service-level agreements (SLAs).
  • Follow data security, access management, governance, and sensitive-data protection best practices.
  • Collaborate with business, analytics, and application teams to deliver effective data solutions.
  • Maintain technical documentation and follow established data engineering standards.


Required Technical Skills :

  • AWS Data Engineering : Strong hands-on experience with AWS-based data engineering and data lake architecture.
  • AWS Services : Amazon S3, AWS Glue, Glue Data Catalog, Amazon EMR, Athena, Redshift, AWS Lambda, and IAM.
  • Programming : Strong proficiency in Python and SQL.
  • Big Data Processing : Hands-on experience with Apache Spark and PySpark.
  • Workflow Orchestration : Experience developing and managing workflows using Apache Airflow.
  • ETL/ELT Development : Experience building scalable data ingestion, transformation, and processing pipelines.
  • Database Technologies : Good understanding of relational databases and PostgreSQL concepts.
  • Data Modelling : Experience with data modelling, data transformation, and analytical data structures.
  • Production Support : Ability to monitor pipelines, troubleshoot failures, perform RCA, and resolve production issues.
  • Performance Optimization : Experience optimizing SQL queries, Spark jobs, and data processing workflows.


Good-to-Have Skills :

  • Experience with AWS Database Migration Service (DMS) and Amazon RDS.
  • Familiarity with dbt for data transformation and modelling.
  • Knowledge of Delta Lake, Apache Iceberg, or Apache Hudi.
  • Exposure to Apache Kafka and real-time data streaming.
  • Familiarity with GraphQL, Hasura, or similar data-serving technologies.
  • Understanding of data governance and data quality frameworks.
  • Experience in the BFSI, healthcare, or health insurance domain.


Candidate Requirements :

  • 5+ years of relevant experience in Data Engineering.
  • Proven hands-on experience building and maintaining production-grade data pipelines on AWS.
  • Strong understanding of data lake architecture and large-scale data processing.
  • Practical experience with Apache Airflow and Spark / PySpark-based transformations.
  • Strong programming, analytical, debugging, and problem-solving skills.
  • Experience handling production incidents, pipeline failures, and performance bottlenecks.
  • Ability to take ownership of deliverables and work effectively with cross-functional teams.
  • Good communication, collaboration, and technical documentation skills.
  • Willingness to work from the Gurugram office five days a week.


Ideal Candidate :

The ideal candidate is a hands-on Data Engineer who can independently build, optimize, and maintain AWS-based data pipelines, work with large datasets using PySpark, orchestrate workflows through Airflow, and resolve production issues in a business-critical environment.

Read more
VY SYSTEMS PRIVATE LIMITED
Bengaluru (Bangalore)
5 - 7 yrs
₹4L - ₹20L / yr
Data Engineer,
skill iconPython
ETL
DevOps

Job Summary

Role Overview

We are looking for an experienced Data Engineer with strong expertise in Python, ETL, Advanced SQL, CI/CD, DevOps, and Data Analytics. The ideal candidate should have hands-on experience designing and developing scalable data pipelines, transforming large datasets, and supporting data-driven applications.

Experience with Google Cloud Platform (GCP) will be an added advantage.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and SQL.
  • Develop complex and optimized SQL queries, stored procedures, and data transformations.
  • Build and maintain reliable data integration workflows across multiple data sources.
  • Perform data cleansing, validation, transformation, and quality checks.
  • Analyze data and provide insights to support business and technical requirements.
  • Implement and maintain CI/CD pipelines for data engineering applications.
  • Work with DevOps practices and tools to automate deployments, monitoring, and infrastructure processes.
  • Troubleshoot data pipeline failures, performance issues, and production incidents.
  • Optimize data processing workflows for performance, scalability, and reliability.
  • Collaborate with Data Analysts, Data Scientists, Developers, and other stakeholders.
  • Follow best practices for version control, testing, documentation, and deployment.
  • Contribute to cloud-based data engineering initiatives, preferably on GCP.

Required Skills

  • 5–7 years of hands-on experience in Data Engineering.
  • Strong programming skills in Python.
  • Strong expertise in Advanced SQL and database concepts.
  • Hands-on experience with ETL/ELT processes and data pipelines.
  • Good understanding of Data Warehousing and Data Modeling concepts.
  • Experience with CI/CD practices and tools.
  • Strong understanding of DevOps principles, automation, and deployment processes.
  • Strong data analytics and problem-solving skills.
  • Experience working with large datasets and performance optimization.
  • Good understanding of Git/version control and software development best practices.

Good to Have

  • Hands-on experience with Google Cloud Platform (GCP).
  • Exposure to GCP data services such as BigQuery, Cloud Storage, Dataflow, Composer, or Pub/Sub.
  • Experience with containerization/orchestration technologies such as Docker/Kubernetes.
  • Experience with workflow orchestration tools such as Airflow.
  • Knowledge of cloud-based data architecture and distributed data processing.

Preferred Candidate Profile

  • Strong analytical and problem-solving abilities.
  • Good communication and stakeholder management skills.
  • Ability to work independently as well as in a collaborative team environment.
  • Strong ownership of data pipelines and production systems.
  • Candidates who can join at short notice are preferred.

Mandatory Skills

 Data Engineer, Python , ETL, GCP, Advanced SQL, Strong Data Analytics skills, CICD, Devops


Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos