Cutshort logo
For Employers
PhotonMatters logo
Data Engineer

Data Engineer at PhotonMatters · Remote only · 4 - 13 years · ₹8L - ₹20L / yr · Bootstrapped · Remote only · Posted 16 Mar 2026

PhotonMatters's logo

Data Engineer

Human Resource's profile picture
Posted by Human Resource
4 - 13 yrs
₹8L - ₹20L / yr
Remote only
Skills
skill iconPython
ETL
Spark
skill iconAmazon Web Services (AWS)
ELT
PySpark
Apache Kafka

 

 

 

Job Title: Data Engineer

Experience: 4–14 Years

Work Mode: Remote

Employment Type: Full-Time

 

Position Overview:

We are looking for highly experienced Senior Data Engineers to design, architect, and lead scalable, cloud-based data platforms on AWS. The role involves building enterprise-grade data pipelines, modernizing legacy systems, and developing high-performance scoring engines and analytics solutions and collaborate closely with architecture, analytics, risk, and business teams to deliver secure, reliable, and scalable data solutions.

 

Key Responsibilities:

·      Design and build scalable data pipelines for financial and customer data

·      Build and optimize scoring engines (credit, risk, fraud, customer scoring)

·      Design, develop, and optimize complex ETL/ELT pipelines (batch & real-time)

·      Ensure data quality, governance, reliability, and compliance standards

·      Optimize large-scale data processing using SQL, Spark/PySpark, and cloud technologies

·      Lead cloud data architecture, cost optimization, and performance tuning initiatives

·      Collaborate with Data Science, Analytics, and Product teams to deliver business-ready datasets

·      Mentor junior engineers and establish best practices for data engineering

 

Key Requirements:

·      Strong programming skills in Python and advanced SQL

·      Experience building scalable scoring or rule-based decision engines

·      Hands-on experience with Big Data technologies (Spark/PySpark/Kafka)

·      Strong expertise in designing ETL/ELT pipelines and data modeling

·      Experience with cloud platforms (AWS/Azure) and modern data architectures

·      Solid understanding of data warehousing, data lakes, and performance tuning

·      Knowledge of CI/CD, version control (Git), and production support best practices

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About PhotonMatters

Founded :
2022
Type :
Products & Services
Size :
20-100
Stage :
Bootstrapped

About

N/A

Company social profiles

linkedin

Similar jobs (10)

VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 9 yrs
₹10L - ₹17L / yr
skill iconPython
PySpark
SQL
data engineer

role: data engineer

Python pyspark, SQL, data engineer

5+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
QuaXigma IT solutions Private Limited
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Tirupati, Chennai
5 - 10 yrs
Best in industry
SQL
skill iconPython
Stored Procedures
skill iconAmazon Web Services (AWS)
Microsoft Windows Azure
+10 more

About Us:

The QX Impact was launched with a mission to make A.I accessible and affordable and deliver AI Products/Solutions at scale for the enterprises by bringing the power of Data, AI, and Engineering to drive digital transformation. We believe without insights; businesses will continue to face challenges to better understand their customers and even lose them. Secondly, without insights businesses won't’ be able to deliver differentiated products/services; and finally, without insights, businesses can’t achieve a new level of “Operational Excellence” is crucial to remain competitive, meeting rising customer expectations, expanding markets, and digitalization.


Job Summary:

We are looking for a Senior Data Engineer who is creative, collaborative, and adaptable to join our agile team of data scientists, engineers, and UX developers. The role focuses on building and maintaining robust data pipelines to support advanced analytics, data science, and BI solutions.

As a Senior Data Engineer, you will work with internal and external data, collaborate with data scientists, and contribute to the design, development, and deployment of innovative solutions.


Key Responsibilities:

  • Design, develop, test, and maintain optimal data pipeline and ETL architectures.
  • Map out data systems and define/design required integrations, ETL, BI, and AI systems/processes.
  • Prepare and optimize data for predictive and prescriptive modeling.
  • Collaborate with teams to integrate ERP data into the enterprise data lake, ensuring seamless flow and quality.
  • Enhance cloud data infrastructure on AWS or Azure for scalability and performance.
  • Utilize big data tools and frameworks to optimize data acquisition and preparation.
  • Build architectures to move data to/from data lakes and data warehouses for advanced analytics.
  • Develop and curate data models for analytics, dashboards, and reports.
  • Conduct code reviews, maintain production-level code, and implement testing approaches.
  • Monitor, troubleshoot, and resolve data ingestion workflows to maintain reliability and uptime.
  • Drive innovation and implement efficient new approaches to data engineering tasks.


Must-Have Skills:

  • Bachelor’s degree in Computer Science, Mathematics, Engineering, or a related field.
  • 5+ years of experience working with enterprise data platforms, including building and managing data lakes.
  • 3–5 years of experience designing and implementing data warehouse solutions.
  • Expertise in SQL, including developing stored procedures (SP) and applying advanced data design concepts.
  • Proficiency in Spark (Python/Scala) and Spark Streaming for real-time data pipelines.
  • Experience with AWS or Azure services (e.g., AWS Glue, Azure Data Factory, Redshift, Snowflake).
  • Familiarity with big data tools such as Apache Kafka, Apache Spark, or Flink.
  • Hands-on experience with orchestration tools (e.g., Apache Airflow, Prefect).
  • Knowledge of CI/CD processes, version control (e.g., Git, Jenkins), and deployment automation.
  • Strong problem-solving, communication, and collaboration skills.


Good-to-Have Skills:

  • Experience in integrating ERP data into data lakes.
  • Experience with traditional ETL tools (e.g., Talend, Pentaho).


Competencies:

  • Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.
  • Self-Development - Actively seeking new ways to grow and be challenged using both formal and informal development channels.
  • Action Oriented - Taking on new opportunities and tough challenges with a sense of urgency, high energy, and enthusiasm.
  • Customer Focus - Building strong customer relationships and delivering customer-centric solutions.
  • Optimize Work Processes - Knowing the most effective and efficient processes to get things done, with a focus on continuous improvement.


Why Join Us?

  • Be part of a collaborative and agile team driving cutting-edge AI and data engineering solutions.
  • Work on impactful projects that make a difference across industries.
  • Opportunities for professional growth and continuous learning.
  • Competitive salary and benefits package.


Application Details

Ready to make an impact? Apply today and become part of the QX Impact team!


Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 10 yrs
₹18L - ₹28L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

9+yrs

Bangalore/Hyderabad

immediate to 15days.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 13 yrs
₹5L - ₹30L / yr
Amazon EMR
skill iconPython
skill iconScala

🚨 HIRING | Data Engineer – Amazon EMR 🔥


We are looking for experienced Data Engineers with strong hands-on expertise in Amazon EMR, Python, and Scala.


📌 JOB DETAILS:


💼 Experience: 6+ Years

💰 CTC: Up to 30 LPA

📍 Location: Bangalore


🔑 MANDATORY SKILLS:


• Amazon EMR

• Python

• Scala

• Data Engineering


📋 KEY REQUIREMENTS:


• 6+ years of relevant experience in Data Engineering.

• Strong hands-on experience with Amazon EMR.

• Strong programming skills in Python and Scala.

• Experience with large-scale data processing and data engineering solutions.

• Strong problem-solving and communication skills.


📩 Interested candidates can share their updated resumes:

📧 pavithra.e @vysystems. com

📞 8 9 2 5 8 0 2 4 5 7


🔄 Know someone who would be a good fit? Tag them or share this post!


#Hiring #DataEngineer #DataEngineering #AmazonEMR #Python #Scala #AWSJobs #BangaloreJobs #ITJobs #TechHiring #HiringNow

Read more
VY SYSTEMS PRIVATE LIMITED
Santhanalakshmi A
Posted by Santhanalakshmi A
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 12 yrs
₹8L - ₹16L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore), Hyderabad
5 - 9 yrs
₹9L - ₹15L / yr
skill iconPython
PySpark
SQL

1st virtual , 2nd round F2F -

Python pyspark, SQL, data engineer

5+yrs

Bang/hyderabad

immediate to 15days.

Read more
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
skill iconAmazon Web Services (AWS)
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Bengaluru (Bangalore)
6 - 9 yrs
₹37L - ₹42L / yr
Data engineering
skill iconPython

Strong Data Engineer (AWS) Profile

2

Mandatory (Experience 1) – Must have minimum 6+ years of experience in Data Engineering, with strong experience designing, developing, and maintaining scalable data pipelines and ETL processes.

3

Mandatory (Experience 2) – Must have 3+ years of hands-on experience with AWS data engineering services, particularly S3, AWS Glue, EMR, Lambda, and Redshift.

4

Mandatory (Experience 3) – Must have strong programming experience in Python, Java, or Scala, with hands-on development of data processing and pipeline solutions.

5

Mandatory (Experience 4) – Must have strong expertise in SQL, data warehousing, and database technologies, including experience with both SQL and NoSQL databases.

6

Mandatory (Experience 5) – Must have hands-on experience working with Big Data technologies and distributed data processing, including designing and optimizing large-scale data pipelines.

7

Mandatory (Experience 6) – Must have experience with data pipeline troubleshooting, monitoring, data quality, governance, and security best practices.

8

Mandatory (Education) – B.Tech / B.E./ M.Tech

Read more
Global Analytical Company
Global Analytical Company
Agency job
via Bean HR Consulting by Tanuja Chauhan
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Gurugram, Bengaluru (Bangalore), Pune
5 - 8 yrs
₹12L - ₹19L / yr
skill iconAmazon Web Services (AWS)
skill iconPython
PySpark
ETL
ELT
+1 more

Job Overview:


We are seeking an experienced Cloud Data Engineer to the architecture, development, Data migration, ETL pipeline in cloud and optimization of a next-generation data platform. This is a development role for an individual with over 4 years of deep data engineering and data migration, data pipeline in AWS expertise, capable of driving technical direction, and delivering high-impact solutions in a fast-paced


4+ Years of hands-on, progressive experience in Cloud Data Engineering, cloud ecosystems AWS, Data Architecture

• Deep conceptual understanding of core data engineering principles, ETL/ELT patterns, and metadata management

•  Ability to translate complex business needs into actionable technical requirements.

•  Strong troubleshooting and problem-solving skills in distributed systems.

•  Agile/Scrum teamwork capabilities and version control practices

• Insurance industry experience preferred but not mandatory

• Tools:

o Cloud Environment: AWS (S3, IAM, VPC, Glue, Lambda etc.)

o Experience with dbt Core, Iceberg, AWS Glue Catalog, AWS lambda, Redshift, Athena, Splunk, AmazonQ, AWS streaming services, Git

o Strong SQL, Pyspark and Python

Read more
VY SYSTEMS PRIVATE LIMITED
icon

Applications on this job are not being reviewed actively. You may apply but please follow up with the company via other channels too.

Hyderabad, Bengaluru (Bangalore)
9 - 14 yrs
₹15L - ₹30L / yr
Lead Generation
skill iconPython
PySpark
SQL
PL/SQL

GCP Data engineer

Exp 9+yrs

Bangalore/Hyderabad

Lead exp+ Python + pyspark + sql or plsql

immediate to 15days joiners

Call or WhatsApp: 6 3 8 5 0 7 6 1 4 2

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos