Cutshort logo
For Employers
Cloudera logo
221142 Staff Software Engineer
221142 Staff Software Engineer

221142 Staff Software Engineer at Cloudera · Remote only · 6 - 10 years · ₹26L - ₹40L / yr (ESOP available) · Profitable · Remote only · Posted 24 Aug 2022

Cloudera's logo

221142 Staff Software Engineer

Rahamath Mallick's profile picture
Posted by Rahamath Mallick
6 - 10 yrs
₹26L - ₹40L / yr (ESOP available)
Remote only
Skills
skill iconJava
skill iconKubernetes
Relational Database (RDBMS)
Data Structures
Spark
Algorithms

Cloudera Data Warehouse Hive team looking for a passionate senior developer to join our growing engineering team. This group is targeting the biggest enterprises wanting to utilize Cloudera’s services in a private and public cloud environment. Our product is built on open source technologies like Hive, Impala, Hadoop, Kudu, Spark and so many more providing unlimited learning opportunities. 

 

A Day in the Life

 

Over the past 10+ years, Cloudera has experienced tremendous growth making us the leading contributor to Big Data platforms and ecosystems and a leading provider for enterprise solutions based on Apache Hadoop. You will work with some of the best engineers in the industry who are tackling challenges that will continue to shape the Big Data revolution.  We foster an engaging, supportive, and productive work environment where you can do your best work. The team culture values engineering excellence, technical depth, grassroots innovation, teamwork, and collaboration.

You will manage product development for our CDP components, develop engineering tools and scalable services to enable efficient development, testing, and release operations.  You will be immersed in many exciting, cutting-edge technologies and projects, including collaboration with developers, testers, product, field engineers, and our external partners, both software and hardware vendors.

 

Opportunity:

 

Cloudera is a leader in the fast-growing big data platforms market. This is a rare chance to make a name for yourself in the industry and in the Open Source world. The candidate will responsible for Apache Hive and CDW projects. We are looking for a candidate who would like to work on these projects upstream and downstream. If you are curious about the project and code quality you can check the project and the code at the following link. You can start the development before you join. This is one of the beauties of the OSS world. 

 

https://hive.apache.org/" target="_blank">Apache Hive

 

Responsibilities:

  • Build robust and scalable data infrastructure software

  • Design and create services and system architecture for your projects 

  • Improve code quality through writing unit tests, automation, and code reviews

  • The candidate would write Java code and/or build several services in the Cloudera Data Warehouse. 

  • Worked with a team of engineers who reviewed each other's code/designs and held each other to an extremely high bar for the quality of code/designs

  • The candidate has to understand the basics of Kubernetes.

  • Build out the production and test infrastructure. 

  • Develop automation frameworks to reproduce issues and prevent regressions.

  • Work closely with other developers providing services to our system.

  • Help to analyze and to understand how customers use the product and improve it where necessary.  

 

Qualifications:

  • Deep familiarity with Java programming language.

  • Hands-on experience with distributed systems. 

  • Knowledge of database concepts, RDBMS internals.

  • Knowledge of the Hadoop stack, containers, or Kubernetes is a strong plus.  

  • Has experience working in a distributed team. 

  • Has 3+ years of experience in software development.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Cloudera

Founded :
2008
Type :
Product
Size :
1000-5000
Stage :
Profitable

About

Cloudera delivers an enterprise data cloud platform for any data, anywhere, from the Edge to AI.
Read more

Connect with the team

Profile picture
Prafulla Deori
Profile picture
brijendra rao

Company social profiles

bloglinkedin

Similar jobs (10)

company logo
Meghana Shinde
Posted by Meghana Shinde
Pune
2.5 - 5 yrs
Best in industry
skill iconJava
Spark
Hadoop
Apache HBase
SQL
+1 more

Company Name – Wissen Technology

Group of companies in India – Wissen Technology & Wissen Infotech

Work Location – Whitefield, Bangalore


Website and Company profile:

www.wissen.com


LinkedIn Page:

https://www.linkedin.com/company/wissen-technology/


While you may already know about Wissen and the company history, here is a quick rundown for you.

 

About Wissen Technology:


·    The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015.

·    Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products.

·    Our workforce has highly skilled professionals, with leadership and senior management executives who have graduated from Ivy League Universities like Wharton, MIT, IITs, IIMs, and NITs and with rich work experience in some of the biggest companies in the world.

·    Wissen Technology has grown its revenues by 400% in these five years without any external funding or investments.

·    Globally present with offices US, India, UK, Australia, Mexico, and Canada.

·    We offer an array of services including Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud, Mobility, Agile & DevOps, Quality Assurance & Test Automation.

·    Wissen Technology has been certified as a Great Place to Work®.

·    Wissen Technology has been voted as the Top 20 AI/ML vendor by CIO Insider in 2020.

·    Over the years, Wissen Group has successfully delivered $650 million worth of projects for more than 20 of the Fortune 500 companies.

·    We have served client across sectors like Banking, Telecom, Healthcare, Manufacturing, and Energy. They include likes of Morgan Stanley, Goldman Sachs, MSCI, StateStreet, Flipkart, Swiggy, Trafigura, GE to name a few.


About Role :


Key Responsibilities

  • Build and maintain data transformation pipelines using java Spark
  • Develop and optimize large-scale/CPU intensive data processing using Apache Spark
  • Orchestrate workflows using Airflow
  • Implement data quality checks, testing, and monitoring for pipeline. Good to have exposer into managing metadata, cataloguing, and lineage
  • Support schema evolution, backfills, and incremental processing
  • Ensure pipelines meet SLAs for freshness, reliability, and performance
  • Expertise/working knowledge in Spark and HBase(semantic layer, virtual datasets, Reflections)


Required Skills & Qualifications

  • Strong hands-on experience with 
  • HBase
  • Apache Spark
  • Experience with HBase or similar lakehouse query engines
  • Airflow 
  • Understanding of data catalogs and lineage (e.g., OpenLineage, DataHub, Apache Polaris , openlineage)
  • Proficiency in Java
  • Experience with Git-based development and CI/CD


Nice-to-Have Skills

  • OpenTable format/Iceberg ,Apache Arrow
  • CDC-based analytics pipelines
  • Cloud platforms (AWS)
  • Kubernetes-based data platforms
Read more
company logo
Banu S
Posted by Banu S
Bengaluru (Bangalore)
5 - 15 yrs
₹3L - ₹30L / yr
skill iconJava
skill iconScala
snowflake

4 - 10 years of experience in designing and buildingarchitecting highly resilient data platforms 

∙Strong knowledge of data engineering, architecture and data modeling 

∙Experience in platforms like Databricks and Snowflake 

∙Experience on building applications on cloud (AWS or Azure or Google Cloud) 

∙Strong analytical and problem-solving skills 

∙Prior experience in developing data or computation intensive (e.g. grid based) backend applications is an 

advantage 

∙OOP design skills with an understanding or at least personal interest towards the concepts of Functional 

Programming  

∙Willingness to understand and enhance other people’s code, being able to work in an environment where 

developers will oversee and work on wider components also dealing with older “legacy” code 

 


∙Strong programming skills (Java/ Scala / Python) skills with the willingness to pick up the other language if not 

already mastered at a sufficient level is important 

∙Spring knowledge is an advantage, but in general willingness to learn, work with and even enhance in-house 

developed frameworks is a must 

∙Prior experience in working with Git, Bitbucket, Jenkins, working with PR-s, using JIRA, following the Scrum Agile 

methodology is an advantage 

∙Prior knowledge of financial products is an advantage 

∙Bachelors or Masters in any relevant field of IT/Engineering area is an advantage  

Read more
company logo
Akash Bhatt
Posted by Akash Bhatt
Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Chennai, Hyderabad, Pune, Kolkata
2 - 12 yrs
₹6L - ₹35L / yr
Apache
Spark
Hadoop
Apache Hive
skill iconScala
+1 more

We are looking for a Big Data Engineer to build large-scale data processing systems.


Responsibilities

  • Build batch and streaming pipelines with Spark and Kafka
  • Manage data in the Hadoop ecosystem (HDFS, Hive)
  • Write Spark jobs in Scala or PySpark
  • Tune jobs for performance and cost


Requirements

  • 2+ years of big data engineering
  • Strong hands-on Spark experience
  • Experience with Hadoop, Hive and Kafka
Read more
company logo
Remote only
5 - 10 yrs
Best in industry
ETL
Google Cloud Platform (GCP)
skill iconKubernetes
skill iconScala
Apache Spark

Description

We are looking for Senior Data Engineers to join our AdTech team and build scalable, high-performance data platforms that power advertising insights and analytics. The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Spark and Scala.

You will work on designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.


Key Responsibilities

  • Design, develop, and maintain scalable ETL pipelines for large-scale data processing.
  • Build and optimize distributed data applications using Spark and Scala.
  • Develop reliable, high-performance data pipelines for batch and streaming workloads.
  • Work with large datasets to ensure data quality, consistency, and performance.
  • Collaborate with engineering, product, and analytics teams to deliver robust data solutions.
  • Optimize data workflows for scalability, reliability, and cost efficiency.
  • Deploy and manage data workloads in cloud and containerized environments.
  • Troubleshoot production issues and continuously improve platform performance.


Requirements

Candidates who demonstrate:

  • 5+ years of experience in Data Engineering or Big Data Engineering.
  • Strong hands-on experience with Apache Spark and Scala.
  • Experience building and maintaining ETL pipelines.
  • Familiarity with Google Cloud Storage (GCS).
  • Experience with Kubernetes (K8s).
  • Strong SQL skills and understanding of distributed data processing.
  • Excellent debugging, problem-solving, and performance optimization skills.
  • Strong communication and collaboration skills.



Good to Have

  • Experience with AWS and cloud-native data services.
  • Familiarity with streaming technologies such as Kafka.
  • Experience working on large-scale data platforms or AdTech systems.
  • Exposure to orchestration tools such as Airflow.


Benefits

  • Best-in-class salary: We hire strong talent and compensate accordingly.
  • Proximity Talks: Meet and learn from designers, engineers, product leaders, and AI practitioners.
  • Continuous learning: Work with a world-class team and stay close to the latest in AI, engineering, and product development.
  • High-impact work: Build AI-first systems and products used at scale by global clients.



About Us

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.

Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.

Read more
company logo
Chaitanya Rajadnya
Posted by Chaitanya Rajadnya
Pune
5 - 12 yrs
Best in industry
skill iconJava
Apache Spark
ETL
skill iconAmazon Web Services (AWS)

Key Responsibilities

Build and maintain data transformation pipelines using java Spark

Develop and optimize large-scale/CPU intensive data processing using Apache Spark

Orchestrate workflows using Airflow

Implement data quality checks, testing, and monitoring for pipeline. Good to have exposer into managing metadata, cataloguing, and lineage

Support schema evolution, backfills, and incremental processing

Ensure pipelines meet SLAs for freshness, reliability, and performance

Expertise/working knowledge in Spark and HBase(semantic layer, virtual datasets, Reflections)


Required Skills & Qualifications

Strong hands-on experience with Apache Spark

Experience with HBase/SQL or similar lakehouse query engines

Airflow 

Understanding of data catalogs and lineage (e.g., OpenLineage, DataHub, Apache Polaris , openlineage)

Proficiency in Java

Experience with Git-based development and CI/CD

Read more
company logo
Shakthi M
Posted by Shakthi M
Pune
3 - 6 yrs
Best in industry
skill iconJava
Spark
ETL

Must have experience in Java

Must have experience in Spark

Must have experience in ETL coding

Strong expertise in coding

Read more
company logo
Srikanth Bajgur
Posted by Srikanth Bajgur
Bengaluru (Bangalore)
6 - 12 yrs
Best in industry
skill iconJava
Spark
skill iconSpring Boot
RESTful APIs
skill iconReact.js

Join our product development team at Planview as a Senior Software Engineer I and become a pivotal force on the Viz Core Team. This role offers the unique opportunity to shape and lead the development of data-processing pipelines and APIs that are at the heart of our software solutions. These solutions are designed to streamline and enhance the efficiency of software delivery, resonating deeply with software engineers who strive to build better and faster.



At Planview Viz, which is powered by the innovative “Flow Framework,” you will tackle complex data challenges and develop scalable solutions within an AWS cloud environment. Your efforts will be crucial in revolutionizing how businesses harness and interpret vast amounts of workflow data, transforming it into actionable insights that propel organizational efficiency and effectiveness.



Responsibilities (What you'll do)


  • Create and refine powerful data-processing architectures that integrate seamlessly with a diverse array of external tools, enhancing the way software is delivered across industries.
  • Drive operational excellence by critically analyzing problems, defining requirements, and devising robust solutions that push the boundaries of technology.
  • Lead and inspire a team of talented engineers, promoting a culture of ownership, meticulous attention to quality, and proactive problem-solving.
  • Stay at the cutting edge of technology by updating and expanding your team’s knowledge of cloud architectures, data processing, and advanced analytics, ensuring that you and your team remain leaders in technological innovation.
  • Make a direct impact on the efficiency and effectiveness of software delivery worldwide through innovation and leadership.


Qualifications (What you'll bring)


Who We’re Looking For

The ideal candidate is a seasoned professional in cloud software development with a strong foundation in data processing and scalable software systems. You thrive in collaborative environments and are passionate about advancing cloud technology and data architecture to new heights. You are a leader who enjoys mentoring, guiding, and inspiring others.


Preferred Qualifications


Skills, Knowledge, and Expertise


  • A degree in Computer Science, Engineering, or a related field.
  • 6+ years of experience with a modern programming language, with a focus on back-end systems and cloud-based technologies.
  • Strong capability in architecting and designing robust, scalable software systems.
  • Proficiency in AWS or another popular cloud platform.


Additional Qualifications


  • Experience with big-data technologies such as Spark and Apache Kafka.
  • Experience with Java (version 17), Scala, or other JVM programming languages.
  • Experience with tools such as Amazon Redshift and MongoDB.
  • Experience with continuous integration and continuous deployment tools such as GitHub, Jenkins, Travis CI, or similar platforms.
  • Proficiency in test-driven development.
  • Experience with containers and orchestration tools such as Kubernetes.
  • Experience working on remote or distributed teams and projects.

 

Read more
company logo
Omprakash Mishra
Posted by Omprakash Mishra
Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconJava
skill iconAmazon Web Services (AWS)
CI/CD

We’re seeking a highly skilled, execution-focused Senior Backend Engineer with a minimum of 5 years of experience to join our team. This role demands hands-on expertise in building and scaling distributed systems, strong proficiency in Java, and deep knowledge of cloud-native infrastructure. You will be expected to design robust backend services, optimize performance across storage and caching layers, and enable seamless integrations using modern messaging and CI/CD pipelines.

You’ll be working in a high-scale, high-impact environment where reliability, speed, and efficiency are paramount. If you enjoy solving complex engineering challenges and have a passion for distributed systems, this is the right role for you.


Responsibilities—

  • Design, develop, and maintain distributed backend systems at scale.
  • Write high-performance, production-grade code in Java.
  • Architect and optimize storage systems, ensuring efficient query performance and scalable data models.
  • Implement caching strategies to reduce latency and improve system throughput.
  • Build and manage services leveraging AWS cloud infrastructure.
  • Develop resilient messaging pipelines using Kafka (or equivalent) for real-time data processing.
  • Define and streamline CI/CD pipelines, ensuring rapid and reliable deployment cycles.
  • Collaborate with product managers, frontend engineers, and DevOps to deliver end-to-end solutions.
  • Monitor system performance, identify bottlenecks, and apply proactive fixes.
  • Drive best practices in software engineering, testing, and code reviews. 


Requirements—

  • 5+ years of experience in backend engineering, with deep hands-on coding experience.
  • Strong proficiency in Java and familiarity with modern frameworks.
  • Proven track record in building scalable distributed systems.
  • Hands-on expertise with AWS services (e.g., EC2, S3, Lambda, DynamoDB, RDS).
  • Solid understanding of messaging systems like Kafka, RabbitMQ, or similar.
  • Strong grasp of query performance optimization and storage system design.
  • Experience with caching solutions (Redis, Memcached, etc.).
  • Familiarity with CI/CD tools (Jenkins, GitHub Actions, GitLab CI, etc.).
  • Excellent problem-solving skills and ability to thrive in fast-paced environments.
  • Strong communication and collaboration skills, with a proactive mindset.


Benefits—

  • Best in class salary: We hire only the best, and we pay accordingly.
  • Proximity Talks: Meet other designers, engineers, and product geeks — and learn from experts in the field.
  • Keep on learning with a world-class team: Work with the best in the field, challenge yourself constantly, and learn something new every day.


About us—

Proximity is the trusted technology, design, and consulting partner for some of the biggest Sports, Media, and Entertainment companies in the world. We’re headquartered in San Francisco and have offices in Palo Alto, Dubai, Mumbai, and Bangalore.

Since 2019, Proximity has built high-impact, scalable products used by millions of users every day. Today, we are a global team of engineers, designers, product managers, and experts solving complex problems and building cutting-edge technology at scale.


Read more
company logo
icon

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

Bengaluru (Bangalore)
14 - 25 yrs
₹50L - ₹70L / yr
Data engineering
databricks
Apache Spark
PySpark
skill iconPython
+19 more

Job Title : Senior Data Engineer – Databricks

Experience : 14 to 20 Years

Location : HSR Layout, Bangalore

Work Mode : Hybrid – 3 Days WFO

Shift : 11:30 AM – 07:30 PM IST

Positions : 2

Notice Period : Immediate Joiners Only

Interview : 1 Technical Round + 2 Client Rounds


Role Overview :

We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.

The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.


Must-Have Skills :

  • 14 to 20 years of Data Engineering experience
  • Databricks & Apache Spark / PySpark
  • Python & SQL
  • AWS Cloud
  • Lakehouse Architecture
  • ETL / ELT & Distributed Data Processing
  • Batch & Streaming Pipelines
  • Data Pipeline Optimization & Data Modeling
  • CDC & Incremental Processing
  • Git, CI/CD & Testing
  • Data Quality, Monitoring & Observability
  • Technical Leadership & Stakeholder Management


Key Responsibilities :

  • Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
  • Own data products from design through production.
  • Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
  • Optimize pipelines for performance, scalability, reliability, and cost.
  • Design scalable data architectures and data models.
  • Implement data quality, monitoring, lineage, and CI/CD practices.
  • Lead technical discussions and mentor engineering teams.
  • Collaborate with business stakeholders, architects, product owners, and engineering teams.
  • Remain hands-on while providing technical leadership.


Ideal Candidate :

A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.

🔴 Super Urgent : Only Bangalore-based immediate joiners.

Read more
company logo
Tushar Vaghela
Posted by Tushar Vaghela
Bengaluru (Bangalore)
5 - 10 yrs
Best in industry
skill iconPython
skill iconScala
Apache Spark
Apache Kafka
databricks
+1 more

Description


We are looking for Senior Data Engineers to join our Data Platform team and build scalable, high-performance data platforms that power data processing, analytics, and downstream applications.

The ideal candidate will have strong experience in distributed data processing, ETL pipelines, and Big Data technologies, with hands-on expertise in Apache Spark and Python Scala.

You will be responsible for designing, developing, and optimizing large-scale data pipelines while collaborating closely with cross-functional engineering teams to build reliable, production-grade data solutions.



Key Responsibilities

  • Design, develop, and maintain scalable ETL and data processing pipelines for large-scale datasets.
  • Build and optimize distributed data applications using Apache Spark and Python Scala.
  • Develop reliable, high-performance data pipelines for batch and streaming workloads.
  • Design and manage data workflows using Apache Airflow.
  • Build and operate data workloads on AWS, with strong usage of Amazon S3 for large-scale data storage.
  • Work with large datasets to ensure data quality, consistency, reliability, and performance.
  • Collaborate with engineering, product, analytics, and other platform teams to deliver robust data solutions.
  • Optimize data workflows for scalability, reliability, performance, and cost efficiency.
  • Troubleshoot production issues, identify bottlenecks, and continuously improve platform performance.



Requirements

Candidates who demonstrate:

  • 5+ years of experience in Data Engineering, Big Data Engineering, or a similar role.
  • Strong hands-on experience with Apache Spark and Scala.
  • Experience designing, building, and maintaining large-scale ETL pipelines.
  • Strong hands-on experience with AWS, particularly Amazon S3.
  • Hands-on experience with Apache Airflow for workflow orchestration and scheduling.
  • Strong SQL skills and a solid understanding of distributed data processing concepts.
  • Experience working with batch and/or streaming data pipelines.
  • Excellent debugging, problem-solving, and performance optimization skills.
  • Strong communication and collaboration skills.


Good to Have

  • Experience with Databricks and the broader Databricks data platform.
  • Familiarity with streaming technologies such as Apache Kafka.
  • Experience working on large-scale data platforms handling high-volume data workloads.
  • Exposure to additional AWS data services and cloud-native data architectures.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos