Cutshort logo
For Employers
Sigmoid logo
Java Big data Developer
Java Big data Developer

Java Big data Developer at Sigmoid · Bengaluru (Bangalore), Hyderabad · 2 - 5 years · ₹12L - ₹15L / yr · Raised funding · Posted 8 Apr 2024

Sigmoid's logo

Java Big data Developer

Jayakumar AS's profile picture
Posted by Jayakumar AS
2 - 5 yrs
₹12L - ₹15L / yr
Bengaluru (Bangalore), Hyderabad
Skills
PySpark
Data engineering
Big Data
Hadoop
Spark
06692
Java Architecture for XML Binding (JAXBJava Architecture for XML Binding...
Data Structures
Algorithms
Apache HBase

Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer.


This position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to

spend a majority of their time coding.


Location - Bengaluru and Hyderabad


Responsibilities:

● Good development practices

○ Hands on coder with good experience in programming languages like Java or

Python.

○ Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.

○ Good understanding of programming principles and development practices like checkin policy, unit testing, code deployment

○ Self starter to be able to grasp new concepts and technology and translate them into large scale engineering developments

○ Excellent experience in Application development and support, integration development and data management.

● Align Sigmoid with key Client initiatives

○ Interface daily with customers across leading Fortune 500 companies to understand strategic requirements


● Stay up-to-date on the latest technology to ensure the greatest ROI for customer &Sigmoid

○ Hands on coder with good understanding on enterprise level code

○ Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems

○ Experience in defining technical requirements, data extraction, data

transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment


● Culture

○ Must be a strategic thinker with the ability to think unconventional /

out:of:box.

○ Analytical and data driven orientation.

○ Raw intellect, talent and energy are critical.


○ Entrepreneurial and Agile : understands the demands of a private, high growth company.

○ Ability to be both a leader and hands on "doer".


Qualifications: -

- Years of track record of relevant work experience and a computer Science or related technical discipline is required

- Experience with functional and object-oriented programming, Java must.

- hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch.

- Effective communication skills (both written and verbal)

- Ability to collaborate with a diverse set of engineers, data scientists and product managers

- Comfort in a fast-paced start-up environment


Preferred Qualification:

- Technical knowledge in Map Reduce, Hadoop & GCS Stack a plus.

- Experience in agile methodology

- Experience with database modeling and development, data mining and warehousing.

- Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff

- Experience working with large, complex data sets from a variety of sources

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Sigmoid

Founded :
2013
Type :
Services
Size :
1000-5000
Stage :
Raised funding

About

Sigmoid is a leading Data Solutions company offering best-in-class services in Data Engineering and Data Science (ML, AI). Our team is strongly driven by the passion to unravel data complexities. We generate actionable insights and translate them into successful business strategies. We leverage our expertise in Open Source and Cloud Technologies to develop innovative frameworks catering to specific customer needs. Our unique approach has positively influenced the business performance of our Fortune 1000 clients across the globe. We have a particularly strong presence in Retail-CPG, BFSI, Advertising, and Hi-Tech industries, wherein we are working with Top-3 players in each of these sectors. Backed by Sequoia Capital, Sigmoid operates out of NY, SF, Dallas, Lima, and Bengaluru. We are recognized among the world's most innovative tech companies and have won several awards like the Aegis Graham Bell Award, TiE50 Winners, and NASSCOM Emerge 50, among others. Learn more: https://www.sigmoid.com/company/ or https://sigmoid.com/careers/ for careers.
Read more

Company video

Sigmoid's video section
Sigmoid's video section

Connect with the team

Profile picture
Karthik Selvaraj
Profile picture
Avinash Kumar nirala
Profile picture
Krupa BU
Profile picture
Avinash Kumar

Company social profiles

bloglinkedintwitterfacebook

Similar jobs (10)

company logo
Agency job
via by Akash Bhatt
Bengaluru (Bangalore), Pune, Hyderabad, Kolkata, Chennai, Mumbai, Gurugram
5 - 10 yrs
₹15L - ₹35L / yr
Data Structures
Systems design
skill iconJava
Algorithms
skill iconPython
+3 more

We're hiring an SDE 2 to build reliable, high-scale services and own features end-to-end. You'll turn ambiguous problems into clean designs, write well-tested code, and raise the engineering bar on the team.

Mandatory skills

• 5+ years shipping production software

• Strong data structures, algorithms and problem-solving

• Hands-on system design for scalable services

• Proficiency in Java or Python

• Building and consuming RESTful APIs

• Solid SQL and version control (Git)

Read more
company logo
Banu S
Posted by Banu S
Bengaluru (Bangalore)
5 - 10 yrs
₹4L - ₹24L / yr
skill iconPython
databricks
snowflake
Data engineering

We are looking for a skilled Python & PySpark Developer with strong expertise in Big Data technologies, Spark, SQL/PL-SQL, and REST API development using Flask or Django. The ideal candidate should have experience building scalable data pipelines, processing large datasets, developing APIs, and working with distributed computing frameworks.

Key Responsibilities

  • Develop, optimize, and maintain scalable data pipelines using PySpark and Apache Spark.
  • Design, develop, and optimize complex SQL and PL/SQL queries, stored procedures, functions, and database objects.
  • Build and maintain RESTful APIs using Flask or Django.
  • Develop robust Python applications for data engineering and backend services.
  • Process and analyze large-scale datasets using Big Data technologies.
  • Optimize Spark jobs for performance, scalability, and reliability.
  • Integrate APIs with internal and external systems.
  • Collaborate with cross-functional teams including Data Engineers, Data Scientists, and Application Developers.
  • Troubleshoot production issues and implement performance improvements.
  • Follow coding standards, version control, and CI/CD best practices.

Mandatory Skills

  • Strong proficiency in Python programming.
  • Hands-on experience with PySpark and Apache Spark.
  • Strong SQL coding skills.
  • Experience with PL/SQL development.
  • Experience in Big Data ecosystem.
  • REST API development using Flask or Django.
  • Experience in developing and consuming Python APIs.
  • Knowledge of data processing, ETL, and distributed computing.
  • Experience with Git/version control.

Preferred Skills

  • Experience with Hadoop ecosystem (Hive, HDFS, YARN).
  • Exposure to cloud platforms such as AWS, Azure, or GCP.
  • Knowledge of Airflow or other workflow orchestration tools.
  • Experience with Docker and Kubernetes.
  • Familiarity with Kafka or other streaming technologies.
  • Understanding of CI/CD pipelines.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • 4–8+ years of experience in Python and Big Data development (can be adjusted based on the role).

Required Experience

  • Strong hands-on experience in Python, PySpark, and Apache Spark.
  • Extensive experience writing optimized SQL and PL/SQL code.
  • Experience developing REST APIs using Flask or Django.
  • Experience working with large-scale data processing and ETL pipelines.
  • Strong analytical, debugging, and problem-solving skills.

Mandatory Skills: Python, PySpark, SQL Coding, Apache Spark, Big Data, Flask/Django (REST API), PL/SQL, Python APIs.

Read more
company logo
Akash Bhatt
Posted by Akash Bhatt
Delhi, Gurugram, Noida, Ghaziabad, Faridabad, Chennai, Hyderabad, Pune, Kolkata
2 - 12 yrs
₹6L - ₹35L / yr
Apache
Spark
Hadoop
Apache Hive
skill iconScala
+1 more

We are looking for a Big Data Engineer to build large-scale data processing systems.


Responsibilities

  • Build batch and streaming pipelines with Spark and Kafka
  • Manage data in the Hadoop ecosystem (HDFS, Hive)
  • Write Spark jobs in Scala or PySpark
  • Tune jobs for performance and cost


Requirements

  • 2+ years of big data engineering
  • Strong hands-on Spark experience
  • Experience with Hadoop, Hive and Kafka
Read more
company logo
Usha Srinivasan
Posted by Usha Srinivasan
Hyderabad
4 - 6 yrs
₹4L - ₹7L / yr
skill iconAngular (2+)
TypeScript


Position Title: Software Engineer

Position Type: Full Time

Department: Research and Development

Reports to: First Level Manager, Indian Development Centre.

 

Company Background:

 

Affiliated with US Group companies, CGLIA Solutions LLP is an innovative Software Product Development Organization developing high available, highly secure, cloud-based enterprise software products catering to the needs of Large Research facilities, University medical centres, Hospitals, Pharma companies in US and worldwide ultimately leading to the development of life saving medications.

 

CGLIA is known for helping Software professionals to unleash their creativity, turning them into world class professionals, and building their career.

 

Job Summary:

 

As a Software Engineer, you assist in the design development of new products for our renowned customers worldwide.

 

Enhancing the existing applications by identifying the areas of improvements, making recommendations and designing and implementing them. 

 

Ideal candidate should be a self-starter and, should have excellent problem-solving skills and passionate about developing high quality innovative products exceeding the customer expectations and needs. A keen interest for quality at every stage of development is a must.

 

Looking for a highly motivated individual who is looking to grow their career in a challenging environment.

 

Responsibilities:

 

  • Participating in discussion with Product Management teams and Generating the Requirement Specification document that has covers both the functional and Non-functional requirements.
  • Participating in discussion with the technical teams and generating the design documents.
  • Develop code and update the existing code, ensuring that all the code meets the agreed upon requirements.
  • Perform intensive testing of all new and existing programs to ensure they are free of errors and function as intended
  • Work closely with the cross functional teams like UI Developers, Business Analysts and Management teams.
  • Cultivate an environment of collaboration, commitment, accountability, and creativity and deliver products and services on time with quality delight the customer.
  • Actively participating in the hiring process, for Organization growth.
  • Updates job knowledge by studying latest development tools, programming techniques, and participating in professional organizations.
  • Willing to undertake additional tasks and responsibilities as may be reasonably expected of the role and as necessary in order to achieve the objectives of the organization.

 

Qualifications: (Education, Experience, Skills and Knowledge)

 

·        Bachelor’s Degree in Computer Science or Information Technology or any equivalent degree.

·        At least 4 plus years of hands on experience in developing cloud-based software.

·        Expertise in developing cloud based distributed applications and must have experience in object-oriented design.

·        Strong hands on experience in using Java, Hibernate, Spring technology stack (Spring MVC, Spring Data, Spring Cloud, Spring Batch, Spring security etc.) along with open source technologies.

  • Experience building web and mobile applications using frontend technologies Angular (Angular 1/Angular 2), Bootstrap, Material Design, UX/UI, JavaScript, HTML5, and CSS.

·        Experience on any one of databases like MySQL, MS SQL, PostgreSQL, and Oracle.

·        Exposure with more than one of the Software Development Methodologies.

·        Knowledge on the Code Static Analyzer tools like SonarQube, PMD etc. and, DevOps Tools.

·        Expertise in Security related to Web Applications and mobile applications. and other open source and commercial tools.

·        Ability to work independently and along with teams.

·        Impeccable written English skills, and Oral communication skills along with outstanding interpersonal skills.

·        Eagerness and willingness to learn new technologies.

Read more
company logo
Jancy A
Posted by Jancy A
Bengaluru (Bangalore)
7 - 13 yrs
₹10L - ₹24L / yr
skill iconPython
PySpark
Oracle
PL/SQL
Google Cloud Platform (GCP)
+2 more

Senior Data Engineer – PySpark & Oracle

Experience: 7+ Years

Location: Bangalore

Notice Period: Immediate to 10 Days

Key Skills:

  • Strong expertise in Data Modeling, Data Design & Modernization
  • Primary skills: PySpark, Oracle SQL/PLSQL
  • Secondary skills: Python, ETL & Data Pipelines
  • Experience with Kafka and Hadoop
  • Exposure to AWS / Azure / GCP
  • Good knowledge of Git and JIRA

Roles & Responsibilities:

  • Design, develop, and modernize scalable data models and data architecture.
  • Develop and optimize data processing solutions using PySpark and Oracle SQL/PLSQL.
  • Build and maintain robust ETL workflows and data pipelines.
  • Work with Kafka, Hadoop, and cloud platforms for data processing and integration.
  • Perform data transformation, optimization, and performance tuning.
  • Collaborate with technical teams on data design, development, testing, and deployment.


Read more
company logo
Srikanth Bajgur
Posted by Srikanth Bajgur
Bengaluru (Bangalore)
6 - 12 yrs
Best in industry
skill iconJava
Spark
skill iconSpring Boot
RESTful APIs
skill iconReact.js

Join our product development team at Planview as a Senior Software Engineer I and become a pivotal force on the Viz Core Team. This role offers the unique opportunity to shape and lead the development of data-processing pipelines and APIs that are at the heart of our software solutions. These solutions are designed to streamline and enhance the efficiency of software delivery, resonating deeply with software engineers who strive to build better and faster.



At Planview Viz, which is powered by the innovative “Flow Framework,” you will tackle complex data challenges and develop scalable solutions within an AWS cloud environment. Your efforts will be crucial in revolutionizing how businesses harness and interpret vast amounts of workflow data, transforming it into actionable insights that propel organizational efficiency and effectiveness.



Responsibilities (What you'll do)


  • Create and refine powerful data-processing architectures that integrate seamlessly with a diverse array of external tools, enhancing the way software is delivered across industries.
  • Drive operational excellence by critically analyzing problems, defining requirements, and devising robust solutions that push the boundaries of technology.
  • Lead and inspire a team of talented engineers, promoting a culture of ownership, meticulous attention to quality, and proactive problem-solving.
  • Stay at the cutting edge of technology by updating and expanding your team’s knowledge of cloud architectures, data processing, and advanced analytics, ensuring that you and your team remain leaders in technological innovation.
  • Make a direct impact on the efficiency and effectiveness of software delivery worldwide through innovation and leadership.


Qualifications (What you'll bring)


Who We’re Looking For

The ideal candidate is a seasoned professional in cloud software development with a strong foundation in data processing and scalable software systems. You thrive in collaborative environments and are passionate about advancing cloud technology and data architecture to new heights. You are a leader who enjoys mentoring, guiding, and inspiring others.


Preferred Qualifications


Skills, Knowledge, and Expertise


  • A degree in Computer Science, Engineering, or a related field.
  • 6+ years of experience with a modern programming language, with a focus on back-end systems and cloud-based technologies.
  • Strong capability in architecting and designing robust, scalable software systems.
  • Proficiency in AWS or another popular cloud platform.


Additional Qualifications


  • Experience with big-data technologies such as Spark and Apache Kafka.
  • Experience with Java (version 17), Scala, or other JVM programming languages.
  • Experience with tools such as Amazon Redshift and MongoDB.
  • Experience with continuous integration and continuous deployment tools such as GitHub, Jenkins, Travis CI, or similar platforms.
  • Proficiency in test-driven development.
  • Experience with containers and orchestration tools such as Kubernetes.
  • Experience working on remote or distributed teams and projects.

 

Read more
company logo
icon

The recruiter has not been active on this job recently. You may apply but please expect a delayed response.

Bengaluru (Bangalore)
14 - 25 yrs
₹50L - ₹70L / yr
Data engineering
databricks
Apache Spark
PySpark
skill iconPython
+19 more

Job Title : Senior Data Engineer – Databricks

Experience : 14 to 20 Years

Location : HSR Layout, Bangalore

Work Mode : Hybrid – 3 Days WFO

Shift : 11:30 AM – 07:30 PM IST

Positions : 2

Notice Period : Immediate Joiners Only

Interview : 1 Technical Round + 2 Client Rounds


Role Overview :

We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.

The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.


Must-Have Skills :

  • 14 to 20 years of Data Engineering experience
  • Databricks & Apache Spark / PySpark
  • Python & SQL
  • AWS Cloud
  • Lakehouse Architecture
  • ETL / ELT & Distributed Data Processing
  • Batch & Streaming Pipelines
  • Data Pipeline Optimization & Data Modeling
  • CDC & Incremental Processing
  • Git, CI/CD & Testing
  • Data Quality, Monitoring & Observability
  • Technical Leadership & Stakeholder Management


Key Responsibilities :

  • Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
  • Own data products from design through production.
  • Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
  • Optimize pipelines for performance, scalability, reliability, and cost.
  • Design scalable data architectures and data models.
  • Implement data quality, monitoring, lineage, and CI/CD practices.
  • Lead technical discussions and mentor engineering teams.
  • Collaborate with business stakeholders, architects, product owners, and engineering teams.
  • Remain hands-on while providing technical leadership.


Ideal Candidate :

A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.

🔴 Super Urgent : Only Bangalore-based immediate joiners.

Read more
company logo
Agency job
via by Akash Bhatt
Bengaluru (Bangalore), Pune, Hyderabad, Kolkata, Chennai, Gurugram, Mumbai
6 - 12 yrs
₹15L - ₹40L / yr
skill iconJava
skill iconPython
SQL
skill iconNodeJS (Node.js)
Microservices
+2 more

We are looking for a Backend Software Development Engineer with 6+ years building scalable, high-availability server-side systems. You'll design and own microservices and REST APIs, model data in SQL, and deploy on AWS, partnering with product and frontend teams end-to-end.

Mandatory skills

• 6+ years of backend development in Java and/or Python

• Strong hands-on experience designing microservices and RESTful APIs

• Solid database design and SQL optimization

• Production experience on AWS (or equivalent cloud)

• Strong CS fundamentals — data structures, concurrency, system design

• Experience owning services from design through production support

Read more
company logo
Anisha Jindal
Posted by Anisha Jindal
Bengaluru (Bangalore), Mumbai
5 - 14 yrs
Best in industry
Data engineering
skill iconPython
PySpark
DAX
PowerBI

Job Summary

We are looking for a skilled and experienced Data Engineer to join our growing data team. The ideal candidate will have strong expertise in Python, PySpark, Data Modeling, and Power BI, with hands-on experience in designing, developing, and optimizing scalable data solutions. The role requires working closely with business stakeholders, data architects, and analytics teams to build robust data pipelines and semantic models that enable data-driven decision-making.


Technical Skills

  • Strong hands-on experience in Python and PySpark development.
  • Expertise in building and optimizing Data Engineering solutions and ETL pipelines.
  • Strong understanding of Data Modeling concepts (Star Schema, Snowflake Schema, Dimensional Modeling).
  • Experience with Power BI Data Modeling and Semantic Layer development.
  • Proficiency in DAX (Data Analysis Expressions).
  • Experience designing and managing Semantic Models in Power BI.
  • Strong SQL skills and experience working with large datasets.
  • Knowledge of data warehousing concepts and best practices.


Preferred Skills

  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Exposure to modern data platforms like Databricks.
  • Understanding of data governance and data quality frameworks.
Read more
Bengaluru (Bangalore)
3 - 6 yrs
₹8L - ₹16L / yr
skill iconJava
skill iconSpring Boot
skill iconGo Programming (Golang)
Gin
grpc
+11 more

Job Title : Software Development Engineer II (SDE 2) – Java or Golang (Backend)

Experience : 3+ Years

Location : Bengaluru

Working Days : 5 Days WFO

Notice Period : Immediate to 15 Days

Interview Process : 3 Client Rounds


Job Overview :

We are looking for an SDE 2 – Backend with strong hands-on experience in Java / Spring Boot or Golang to design, develop, and maintain scalable, high-performance backend applications. Candidates with experience in caching services will be highly preferred.


Mandatory Skills :

Java, Spring Boot, Golang, Gin, gRPC, REST APIs, Microservices, MySQL / PostgreSQL / Oracle, System Design, Caching, Data Structures & Algorithms, Git, CI/CD, Docker, Kubernetes, AWS / GCP.


Key Responsibilities :

  • Design, develop, test, and deploy scalable backend applications and APIs.
  • Develop microservices using Java / Spring Boot or Golang.
  • For Golang roles, experience with Gin and gRPC is preferred.
  • Work with MySQL, PostgreSQL, Oracle, or similar databases.
  • Design and optimize caching solutions for application performance.
  • Participate in system design and architecture discussions.
  • Conduct code reviews and write unit/integration tests.
  • Troubleshoot bugs and performance issues.
  • Collaborate with Product, QA, and other engineering teams.
  • Contribute to CI/CD, cloud, and DevOps practices.


Requirements :

  • 3 to 5 years of backend development experience.
  • Strong proficiency in Java / Spring / Spring Boot or Golang.
  • Good understanding of REST APIs, Microservices, DSA, and System Design.
  • Experience with relational databases.
  • Strong debugging and problem-solving skills.
  • Exposure to AWS/GCP, Docker, Kubernetes, Git, and CI/CD.
  • Java candidates with end-to-end application design experience are preferred.
  • Exposure to AI/ML tools or Low-Code/No-Code frameworks is a plus.


Interview Process :

Round 1 – LeetCode / Coding Round

  • Data Structures & Algorithms
  • Problem-solving and coding proficiency

Round 2 – System Design

  • System architecture
  • Scalability and performance
  • API and database design
  • Caching and distributed systems

Round 3 – Hiring Manager Round

  • Technical depth
  • Project and ownership experience
  • Problem-solving approach
  • Communication and collaboration
  • Role and culture fit
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos