Cutshort logo
Inncircles  logo
Sr. Big Data Engineer
Sr. Big Data Engineer
Inncircles 's logo

Sr. Big Data Engineer

Gangadhar M's profile picture
Posted by Gangadhar M
3 - 5 yrs
Best in industry
Hyderabad
Skills
PySpark
Spark
skill iconPython
ETL
Amazon EMR
Amazon S3
SQL
NOSQL Databases
athena
Apache Kafka
Apache Spark
skill iconMongoDB


We are looking for a highly skilled Sr. Big Data Engineer with 3-5 years of experience in

building large-scale data pipelines, real-time streaming solutions, and batch/stream

processing systems. The ideal candidate should be proficient in Spark, Kafka, Python, and

AWS Big Data services, with hands-on experience in implementing CDC (Change Data

Capture) pipelines and integrating multiple data sources and sinks.


Responsibilities

  • Design, develop, and optimize batch and streaming data pipelines using Apache Spark and Python.
  • Build and maintain real-time data ingestion pipelines leveraging Kafka and AWS Kinesis.
  • Implement CDC (Change Data Capture) pipelines using Kafka Connect, Debezium or similar frameworks.
  • Integrate data from multiple sources and sinks (databases, APIs, message queues, file systems, cloud storage).
  • Work with AWS Big Data ecosystem: Glue, EMR, Kinesis, Athena, S3, Lambda, Step Functions.
  • Ensure pipeline scalability, reliability, and performance tuning of Spark jobs and EMR clusters.
  • Develop data transformation and ETL workflows in AWS Glue and manage schema evolution.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and high-quality data solutions.
  • Implement monitoring, logging, and alerting for critical data pipelines.
  • Follow best practices for data security, compliance, and cost optimization in cloud environments.


Required Skills & Experience

  • Programming: Strong proficiency in Python (PySpark, data frameworks, automation).
  • Big Data Processing: Hands-on experience with Apache Spark (batch & streaming).
  • Messaging & Streaming: Proficient in Kafka (brokers, topics, partitions, consumer groups) and AWS Kinesis.
  • CDC Pipelines: Experience with Debezium / Kafka Connect / custom CDC frameworks.
  • AWS Services: AWS Glue, EMR, S3, Athena, Lambda, IAM, CloudWatch.
  • ETL/ELT Workflows: Strong knowledge of data ingestion, transformation, partitioning, schema management.
  • Databases: Experience with relational databases (MySQL, Postgres, Oracle) and NoSQL (MongoDB, DynamoDB, Cassandra).
  • Data Formats: JSON, Parquet, Avro, ORC, Delta/Iceberg/Hudi.
  • Version Control & CI/CD: Git, GitHub/GitLab, Jenkins, or CodePipeline.
  • Monitoring/Logging: CloudWatch, Prometheus, ELK/Opensearch.
  • Containers & Orchestration (nice-to-have): Docker, Kubernetes, Airflow/Step
  • Functions for workflow orchestration.


Preferred Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
  • Experience in large-scale data lake / lake house architectures.
  • Knowledge of data warehousing concepts and query optimisation.
  • Familiarity with data governance, lineage, and cataloging tools (Glue Data Catalog, Apache Atlas).
  • Exposure to ML/AI data pipelines is a plus.


Tools & Technologies (must-have exposure)

  • Big Data & Processing: Apache Spark, PySpark, AWS EMR, AWS Glue
  • Streaming & Messaging: Apache Kafka, Kafka Connect, Debezium, AWS Kinesis
  • Cloud & Storage: AWS (S3, Athena, Lambda, IAM, CloudWatch)
  • Programming & Scripting: Python, SQL, Bash
  • Orchestration: Airflow / Step Functions
  • Version Control & CI/CD: Git, Jenkins/CodePipeline
  • Data Formats: Parquet, Avro, ORC, JSON, Delta, Iceberg, Hudi
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Inncircles

Founded :
2019
Type :
Product
Size :
100-500
Stage :
Profitable

About

Inncircles Arena – a Modern Construction Management Platform, is a composed one stop solution for construction management that is highly configurable, easily adaptable, data centric while leveraging advanced artificial intelligence and cloud technologies to ramp up construction company's digital transformation initiatives. It empowers construction teams to go beyond the tactical to strategic. Through the platform, residential, industrial and infrastructure construction companies gain real-time insights into their projects, a unified communication and collaboration space, powerful configuration capabilities to integrate with existing or legacy tools and technologies. Detailed products and solution packages allow for planning, scheduling, assigning, tracking, and analyzing construction work packages from pre-planning stage to handover. Solving Construction Business Challenges through Technology • Work Management: Elevate efficiency and transform project management by scheduling works, tracking progress while gaining real-time insights. • Quality Management: Ensure projects meet the required quality standards by performing regular inspections and issue tracking. • Safety Management: Record and monitor safety incidents in real-time, schedule inspections, and store pertinent safety documentation. • Advanced Work Package (AWP): Build package of works, schedule work packages and monitor progress. • Data and Analytics: Gain profound insights of projects through visually stunning dashboards that bring your data to life. • Mobile Application: Offer mobile accessibility to enable field teams to access information, submit updates, and communicate in real-time, improving overall efficiency. • Integrations: Foster connectivity in the construction eco system with Arenas potent integration capabilities. • Pre-Construction Planning: Drive project planning, budgeting, estimating, bidding, and collaboration during the pre-construction phase. • Procurement: Create procurement packages
Read more

Company social profiles

linkedin

Similar jobs

Deqode
at Deqode
1 recruiter
purvisha Bhavsar
Posted by purvisha Bhavsar
Mumbai, Navi Mumbai
2 - 4 yrs
₹4L - ₹18L / yr
skill iconReact.js
skill iconJavascript

🚀 Hiring: React.js

⭐ Experience: 2+ Years

📍 Location: Mumbai

⭐ Work Mode:- 5 Days Work From Office

⏱️ Notice Period: Immediate Joiners or 15 Days

(Only immediate joiners & candidates serving notice period)


We’re looking for a skilled React.js Developer to join our growing team! If you love building dynamic, user-friendly web applications and have strong expertise in React.js, JavaScript (ES6+), and modern front-end tools, this role is for you.


Key Skills:

  • Proficiency in React.js, JavaScript (ES6+), HTML5, CSS3
  • Experience with Redux / Context API
  • Strong knowledge of REST APIs & JSON
  • Familiarity with Git & Agile development
  • Bonus: TypeScript, Next.js, Testing (Jest/Enzyme), UI frameworks (Material-UI/Tailwind)


Read more
Venturessky Ltd
Remote only
7 - 10 yrs
₹12L - ₹18L / yr
skill iconDjango
skill iconFlutter
skill iconReact.js
skill iconPostgreSQL
GraphQL
+2 more

🎯 Role Overview

We are a UK-based SaaS company powering online ordering, POS, and mobile apps for restaurants and takeaways. We already serve 1200+ clients on our legacy platform and are migrating to a modern Python-Django, React, Flutter, microservices stack hosted on OVH Cloud.

We’re looking for a hands-on Senior Architect/Lead based in India (preferably Kerala) who can:

  • Audit and stabilize our current build,


  • Deliver MVP in weeks, not months,


  • And evolve into the future CTO of the company.


This role is high-impact: you’ll work closely with the UK leadership team and lead a growing India-based engineering group.

🛠️ Key Responsibilities

  • Architecture & Ownership


  • Review and refactor existing codebase (Django backend, Flutter apps, React admin).


  • Define clean architecture, APIs, and service boundaries.


  • Simplify into a stable MVP (modular monolith first, microservices later).


  • Delivery Management


  • Enforce agile sprints (2-week cycles).


  • Set up CI/CD pipelines, test automation, QA cycles.


  • Ensure smooth and secure deployments on OVH cloud.


  • Hands-On Development


  • Lead by example — write/refactor core backend/frontend code.


  • Mentor and guide 3 in-house developers (transitioning from PHP/Opencart).


  • Scaling & Future Roadmap


  • Prepare system for multi-language support, payments, POS integrations.


  • Define a 12–24 month tech roadmap aligned with business goals.


  • Explore AI-assisted coding/testing to boost team productivity.


  • Leadership


  • Act as technical counterpart to business leadership in the UK.


  • Build and lead a strong India-based engineering team as we scale.


✅ Required Skills & Experience

  • 7–10 years professional development experience, with at least 3 years leading teams or projects.


  • Strong hands-on expertise in:


  • Python-Django (backend, APIs, ORM, migrations)


  • Flutter (cross-platform apps)


  • React (admin dashboards)


  • DevOps (CI/CD, Docker, cloud deployments)


  • Proven track record of shipping SaaS products from MVP → production.


  • Experience cleaning up/refactoring messy codebases.


  • Ability to mentor mid-level and junior devs.


  • Bonus: Experience with restaurant/retail tech, POS, or fintech/payments.


🚀 Desirable Traits

  • Pragmatic “builder” mindset → knows how to cut complexity and ship fast.


  • Hands-on problem solver, not just a PowerPoint architect.


  • Ambition to grow into CTO role (lead a larger tech org, own platform strategy).


  • Strong communicator — can bridge between UK business team and India dev team.


💼 What We Offer

  • Competitive salary for senior-level (₹12 -  ₹18 lakhs INR / year depending on experience).


  • Future CTO track opportunity.


  • Chance to lead the rebuild of a SaaS platform already trusted by 1200+ businesses.


  • Direct collaboration with UK leadership, high ownership and visibility.


📌 How to Apply

Send CV + GitHub/LinkedIn. In your cover note, describe:

  • A time you had to rescue a struggling project.


  • Your experience with Django + Flutter + React in one product.


  • Why you’d want to grow into CTO responsibilities.


Read more
Root Node India
Remote, Bengaluru (Bangalore)
3 - 4 yrs
₹12L - ₹14L / yr
skill iconJava
skill iconSpring Boot
RESTful APIs
skill iconAmazon Web Services (AWS)
skill iconMongoDB
+1 more

About Root Node

We’re an early-stage startup building intelligent tools for planning, scheduling, and optimization—starting with timetabling and warehouse logistics. Backed by deep domain expertise and a growing customer pipeline, we’re now building our core tech team. This is not just a coding job — it's a chance to build something meaningful from the ground up.


About the job

  • Design and implement robust backend systems and APIs using Java or similar backend language and Spring Boot or equivalent frameworks
  • Integrate backend services with existing custom ERP systems 
  • Work closely with the founder on product architecture, feature prioritization, and go-to-market feedback
  • Take full ownership of features — from system design and development to deployment and iterative improvements
  • Help shape our engineering culture and technical foundations


You're a Great Fit If You:

  • Have 3+ years of experience in backend development
  • Are strong in Java or similar languages (e.g., Kotlin, Go, Node.js)
  • Have solid experience with Spring Boot or equivalent backend frameworks
  • Have integrated with ERP or enterprise systems in production environments
  • Are comfortable with both SQL (PostgreSQL) and NoSQL (MongoDB)
  • Understand REST API development, authentication, Docker
  • Have an entrepreneurial mindset — you're excited about ownership, ambiguity, and making decisions that shape the product and company
  • Want more than just a job — you want to build, solve, and learn rapidly


What We Offer

  • Competitive salary
  • High degree of ownership and autonomy
  • Ability to shape the tech and product direction from Day 1
  • Transparent and fast decision-making culture
  • A builder’s environment — solve real-world problems with real impact
Read more
Hybrid, Hyderabad, Noida, Gurugram
7 - 12 yrs
₹25L - ₹35L / yr
skill iconVue.js
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconReact.js
skill iconJavascript
+6 more

Job Description: Software Engineering –Sr. Software Engineer

Key Responsibilities - Responsible for design, problem solving, develop, modify, debug and/or maintain software system for one or more specific modules within a large software system scope


Must have:

React JS, Java script, Jquery, JSP, Struts, Java, Spring Framework, Database

 

 

Preferred Skills/Experience:

• 7+ years of hands-on software development experience in designing and implementing complex, distributed applications.

Knowledge on front end technology is must such as React JS / Angular

• Knowledge and real time experience in Designing, Development, and Maintenance of Scalable, Distributed applications.

• Strong experience in Java, Spring Boot-based application on RDBMS (SQL Server ).

• Hands on experience with frameworks like ReactJS, AngularJS, NodeJS and designing Microservice/Event-driven architecture.

• Experience with cloud migration (AWS or Azure) and managing the development of cloud-based applications and development of APIs, web services.

• Capable of troubleshooting errors, finding root causes, resolving failures in real time.

• knowledge of Relational Databases, SQL and ORM Technologies(Hibernate, JPA, Spring Data).

• Experience with version control and source code management tools such as Git, GitHub and Bitbucket.

• Thorough understanding of Java and J2EE Internals (Class Loading, Memory Management, Transaction Management.).

• Knowledge on creation of CI/CD pipelines using Jenkins, Groovy and GitHub actions workflows.

• Knowledge on working and leading Agile/Scrum development cycles.

• Implement test cases using Junit, Mockito, Cucumber, jest

 

Read more
Modernizing Trends Pvt Ltd
Modernizing Trends Pvt Ltd
Agency job
via Milestone Hr Consultancy by Haina khan
Gandhidham, Bengaluru (Bangalore)
1 - 5 yrs
₹2L - ₹6L / yr
Field Sales
Greetings..

We have urgent requirement for Area Sales Manager for our client

Location: Gandhidham

Exp:1-5yrs

Cpmpany delivering the best quality products and services to the customers by hiring diligent and kosher white collars so that the company becomes a productive entity and caters customer satisfaction to the last straw.

Should have interaction with Architect /Interior designer /Consultant
➢ Knowledge to deal with builders would be added advantage
➢ Good Communication skills is a must
➢ Knowledge of computers (excel/word/PowerPoint)

Required Qualification: Mechanical engineer/MBA, Marketing

Read more
one of the world's leading multinational investment bank
one of the world's leading multinational investment bank
Agency job
via HiyaMee by Lithin Raj
Pune
9 - 13 yrs
₹10L - ₹15L / yr
skill iconDocker
skill iconKubernetes
DevOps
skill iconAmazon Web Services (AWS)
Windows Azure
+1 more
  • Hands-on knowledge on various CI-CD tools (Jenkins/TeamCity, Artifactory, UCD, Bitbucket/Github, SonarQube) including setting up of build-deployment automated pipelines.
  • Very good knowledge in scripting tools and languages such as Shell, Perl or Python , YAML/Groovy, build tools such as Maven/Gradle.
  • Hands-on knowledge in containerization and orchestration tools such as Docker, OpenShift and Kubernetes.
  • Good knowledge in configuration management tools such as Ansible, Puppet/Chef and have worked on setting up of monitoring tools (Splunk/Geneos/New Relic/Elk).
  •             Expertise in job schedulers/workload automation tools such as Control-M or AutoSys is good to have.
  • Hands-on knowledge on Cloud technology (preferably GCP) including various computing services and infrastructure setup using Terraform.
  • Should have basic understanding on networking, certificate management, Identity and Access Management and Information security/encryption concepts.
  • •             Should support day-to-day tasks related to platform and environments upkeep such as upgrades, patching, migration and system/interfaces integration.
  • •             Should have experience in working in Agile based SDLC delivery model, multi-task and support multiple systems/apps.
  • •             Big-data and Hadoop ecosystem knowledge is good to have but not mandatory.
  • Should have worked on standard release, change and incident management tools such as ServiceNow/Remedy or similar
Read more
Paytm
at Paytm
41 recruiters
Anuj Kanojia
Posted by Anuj Kanojia
Gurugram, Noida, Bengaluru (Bangalore), Pune
3 - 6 yrs
₹10L - ₹30L / yr
skill iconReact.js
skill iconJavascript
skill iconRedux/Flux

Senior Software Engineer-Frontend

About the role: 

 

We are looking for passionate, talented, and highly motivated hands-on Front End Developers with a creative edge, strong problem solving skills and strong development fundamentals. We strive to maintain an open culture where everyone is a contributor and feels comfortable sharing ideas and opinions. Our team, drawn from the best product companies, is obsessive in its detailing and our focus is on awesome User Interaction.

 

 

Requirements:

 

  • Ability to collaborates with teams to explore existing systems, determines areas of complexity and learns the applications capabilities
  • Complete understanding of internal code and workings on any popular open source library will be highly appreciated
  • Some record of contribution to any popular front end open source project is a big plus.

 

Skills that will help you succeed in this role:

  • An ideal Senior Front End Engineer would have 3-6 years of experience in building highly scalable UI on the Web/Mobile.
  • Highly skilled at building highly performant web applications using  JavaScript, HTML and CSS including frameworks and tools such as React, Redux, Redux saga, Sass, Less etc.
  • Ability to write testable, maintainable code that’s easy to understand.
  • Experience in modern front-end build pipelines and tools.
  • Ability to take complex problems and break them down into smaller tasks.
  • An innate curiosity about how things work.
  • Strong product and design sensibilities and an obsessive attention to detail.
  • Excellent communication skills.
  • Self-directed team player who thrives in a continually changing environment.
  • We are looking for passionate, talented, and highly motivated hands-on Front End Developers with a creative edge, strong problem solving skills and strong development fundamentals. 

 

Read more
Paytm
at Paytm
41 recruiters
Pawan Prakash
Posted by Pawan Prakash
Noida, Bengaluru (Bangalore), Pune
3 - 6 yrs
Best in industry
JMeter
NewRelic
AppDynamics
skill iconJava
gatling
Expectations/ Requirements
3+ Years of experience in performance, scalability, and fault tolerance testing using JMeter, Gatling etc (At least One tool)
2+ Years of performance monitoring and analytics using New Relic, AppDynamics etc (At least One tool)
Working knowledge of RESTful APIs , XML, JSON.
Knowledge of testing and analyzing large and complex systems
Knowledge of Jenkins/Hudson or another continuous integration and release management tool
Working Knowledge in Unix/Linux environment/ Debugging skills
Basic coding skills in Java
 
Skills that will help you succeed in this role
Expert Level coding skills in Java (recent experience in back-end Java desired)
Experience in deploying J2EE applications (in Tomcat etc.)
Good knowledge of SCM tools including Git, subversion
Knowledge of build automation tools e.g. maven
Knowledge of one or more scripting languages e.g. shell, python, ruby, groovy
Excellent written and verbal communication skills
Must be comfortable working with a distributed team
Solid organizational skills including attention to detail and multitasking skills
Read more
It is a product and service based company
It is a product and service based company
Agency job
via GRowth Gamut Pvt. Ltd by Harsha Priya
Bengaluru (Bangalore)
3 - 7 yrs
₹5L - ₹12L / yr
skill iconPython
skill iconDjango
skill iconHTML/CSS
skill iconSASS
SQL
+1 more

Minimum 3+ Years of hands-on experience in developing Python Applications. 
Excellent knowledge of Python and experience in or in-depth understanding of core Python 
Knowledge in Lists, Tuples, and Dictionaries
Excellent knowledge of Python Constructor- Parameterized and Non-Parameterized
Must have experience in core python concepts about data structure, OOPS concepts, XML parsing, XML to JSON, optimizations

Developers should have developed Web Based applications., back end, SQL
Agile and scrum methodology

Should not be test automation, Application development frame work

Excellent Communication Skill


Good to Have 


Django/ Flask 
Strong Hands-on experience in HTML, CSS, DTL(Django Template Language), SASS.
knowledge of SQL

Read more
MediaMelon Inc
at MediaMelon Inc
1 video
2 recruiters
Katreddi Kiran Kumar
Posted by Katreddi Kiran Kumar
Bengaluru (Bangalore), Bengaluru (Bangalore)
2 - 10 yrs
₹0L / yr
skill iconJavascript
skill iconHTML/CSS
skill iconAngularJS (1.x)
skill iconBootstrap
D3.js
+2 more
We are looking for innovative and enterpreneurial individuals who thrive on solving complex problems and want to build innovative products. We are looking for candidates with the following qualifications: Would prefer candidates with 4+ years of experience in development Good knowledge of MVC and other design patterns Good understanding and hands-on development experience in HTML/HTML5, CSS, Javascript, jQuery Must be familiar with Object Oriented Design concepts Experience of working with Angular.js and/or Backbone, Ember, Knockout, requireJS  2+ years of experience with relational and SQL based databases like MySQL as well as NoSQL based databases like MongoDB and CouchDB. 2+ years experience with build platforms such as Maven/Git/Jenkins, Ant scripting. Well versed with Agile Development Methodologies including Scrum. Hands on experience in BigData space (Hadoop Stack like M/R, HDFS, Pig, Hive, HBase, Flume, Sqoop, etc and NoSQL stores like Cassandra, HBase etc) is a Plus. Experience with Adode Photoshop/GIMP/Illustrator will be an advantage Exposure to UI /JS / CSS frameworks such as LESS / SaaS, BootStrap etc Expertise in producing cross browser compatible code and strong ability to troubleshoot JS / browser issues Responsibilities Develop a clean, well structured, easily maintainable code. Design and develop front-end components in Java, Java Script, HTML, CSS, iOS and Android Develop products that are reliable, scalable, and secure. Bug fixing & troubleshooting complex problems in a timely and accurate manner. Education Requirements  Bachelors or Masters (Electrical & Computer Engineering and related) from reputed engineering colleges.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos