Cutshort logo
Inncircles  logo
Sr. Big Data Engineer
Sr. Big Data Engineer
Inncircles 's logo

Sr. Big Data Engineer

Gangadhar M's profile picture
Posted by Gangadhar M
3 - 5 yrs
Best in industry
Hyderabad
Skills
PySpark
Spark
skill iconPython
ETL
Amazon EMR
Amazon S3
SQL
NOSQL Databases
athena
Apache Kafka
Apache Spark
skill iconMongoDB


We are looking for a highly skilled Sr. Big Data Engineer with 3-5 years of experience in

building large-scale data pipelines, real-time streaming solutions, and batch/stream

processing systems. The ideal candidate should be proficient in Spark, Kafka, Python, and

AWS Big Data services, with hands-on experience in implementing CDC (Change Data

Capture) pipelines and integrating multiple data sources and sinks.


Responsibilities

  • Design, develop, and optimize batch and streaming data pipelines using Apache Spark and Python.
  • Build and maintain real-time data ingestion pipelines leveraging Kafka and AWS Kinesis.
  • Implement CDC (Change Data Capture) pipelines using Kafka Connect, Debezium or similar frameworks.
  • Integrate data from multiple sources and sinks (databases, APIs, message queues, file systems, cloud storage).
  • Work with AWS Big Data ecosystem: Glue, EMR, Kinesis, Athena, S3, Lambda, Step Functions.
  • Ensure pipeline scalability, reliability, and performance tuning of Spark jobs and EMR clusters.
  • Develop data transformation and ETL workflows in AWS Glue and manage schema evolution.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and high-quality data solutions.
  • Implement monitoring, logging, and alerting for critical data pipelines.
  • Follow best practices for data security, compliance, and cost optimization in cloud environments.


Required Skills & Experience

  • Programming: Strong proficiency in Python (PySpark, data frameworks, automation).
  • Big Data Processing: Hands-on experience with Apache Spark (batch & streaming).
  • Messaging & Streaming: Proficient in Kafka (brokers, topics, partitions, consumer groups) and AWS Kinesis.
  • CDC Pipelines: Experience with Debezium / Kafka Connect / custom CDC frameworks.
  • AWS Services: AWS Glue, EMR, S3, Athena, Lambda, IAM, CloudWatch.
  • ETL/ELT Workflows: Strong knowledge of data ingestion, transformation, partitioning, schema management.
  • Databases: Experience with relational databases (MySQL, Postgres, Oracle) and NoSQL (MongoDB, DynamoDB, Cassandra).
  • Data Formats: JSON, Parquet, Avro, ORC, Delta/Iceberg/Hudi.
  • Version Control & CI/CD: Git, GitHub/GitLab, Jenkins, or CodePipeline.
  • Monitoring/Logging: CloudWatch, Prometheus, ELK/Opensearch.
  • Containers & Orchestration (nice-to-have): Docker, Kubernetes, Airflow/Step
  • Functions for workflow orchestration.


Preferred Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
  • Experience in large-scale data lake / lake house architectures.
  • Knowledge of data warehousing concepts and query optimisation.
  • Familiarity with data governance, lineage, and cataloging tools (Glue Data Catalog, Apache Atlas).
  • Exposure to ML/AI data pipelines is a plus.


Tools & Technologies (must-have exposure)

  • Big Data & Processing: Apache Spark, PySpark, AWS EMR, AWS Glue
  • Streaming & Messaging: Apache Kafka, Kafka Connect, Debezium, AWS Kinesis
  • Cloud & Storage: AWS (S3, Athena, Lambda, IAM, CloudWatch)
  • Programming & Scripting: Python, SQL, Bash
  • Orchestration: Airflow / Step Functions
  • Version Control & CI/CD: Git, Jenkins/CodePipeline
  • Data Formats: Parquet, Avro, ORC, JSON, Delta, Iceberg, Hudi
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Inncircles

Founded :
2019
Type :
Product
Size :
100-500
Stage :
Profitable

About

Inncircles Arena – a Modern Construction Management Platform, is a composed one stop solution for construction management that is highly configurable, easily adaptable, data centric while leveraging advanced artificial intelligence and cloud technologies to ramp up construction company's digital transformation initiatives. It empowers construction teams to go beyond the tactical to strategic. Through the platform, residential, industrial and infrastructure construction companies gain real-time insights into their projects, a unified communication and collaboration space, powerful configuration capabilities to integrate with existing or legacy tools and technologies. Detailed products and solution packages allow for planning, scheduling, assigning, tracking, and analyzing construction work packages from pre-planning stage to handover. Solving Construction Business Challenges through Technology • Work Management: Elevate efficiency and transform project management by scheduling works, tracking progress while gaining real-time insights. • Quality Management: Ensure projects meet the required quality standards by performing regular inspections and issue tracking. • Safety Management: Record and monitor safety incidents in real-time, schedule inspections, and store pertinent safety documentation. • Advanced Work Package (AWP): Build package of works, schedule work packages and monitor progress. • Data and Analytics: Gain profound insights of projects through visually stunning dashboards that bring your data to life. • Mobile Application: Offer mobile accessibility to enable field teams to access information, submit updates, and communicate in real-time, improving overall efficiency. • Integrations: Foster connectivity in the construction eco system with Arenas potent integration capabilities. • Pre-Construction Planning: Drive project planning, budgeting, estimating, bidding, and collaboration during the pre-construction phase. • Procurement: Create procurement packages
Read more

Company social profiles

linkedin

Similar jobs

WebCoir IT Solutions Private Limited
Noida
1 - 3 yrs
₹2L - ₹7L / yr
Search Engine Optimization (SEO)

Key Responsibilities:

  • Keyword Research: Conduct thorough keyword research using SEO tools like Google Keyword Planner, SEMrush, and Ahrefs to identify target keywords for optimization.
  • On-Page Optimization: Assist in optimizing web pages for SEO, including improving title tags, meta descriptions, headers, and internal linking.
  • Content Optimization: Collaborate with the content team to optimize website content, blog posts, and landing pages to ensure they are search-engine friendly.
  • Technical SEO Support: Assist in monitoring site performance and troubleshooting SEO-related issues like page speed, mobile-friendliness, and site architecture.
  • SEO Audits: Conduct basic SEO audits and analyze websites for performance improvements, including broken links, duplicate content, and other technical factors.
  • Competitor Analysis: Analyze competitor websites and their SEO strategies to uncover new opportunities for improvement.
  • Link Building: Assist in identifying and reaching out for potential backlink opportunities to increase website authority.
  • Reporting: Track SEO performance using Google Analytics, Google Search Console, and other tools to generate insights and monthly reports.
  • Stay Updated: Keep up with the latest SEO trends, algorithm updates, and industry best practices to ensure our strategies are always up to date.


Read more
Tazapay
at Tazapay
1 video
1 recruiter
Harshini  N M
Posted by Harshini N M
Chennai, Bengaluru (Bangalore)
6 - 11 yrs
₹25L - ₹35L / yr
skill iconPython
skill iconGo Programming (Golang)
skill icon.NET
skill iconRuby

 

Job Title - Senior Backend Engineer

About Tazapay 

Tazapay is a cross border payment service provider. They offer local collections via local payment methods, virtual accounts and cards in over 70 markets. The merchant does not need to create local entities anywhere and Tazapay offers the additional compliance framework to take care of local regulations and requirements. This results in decreased transaction costs, fx transparency and higher auth rates. 


They are licensed and backed by leading investors.   www.tazapay.com 


What’s exciting waiting for You? 

This is an amazing opportunity for you to join a fantastic crew before the rocket ship launch. It will be a story you will carry with you through your life and have the unique experience of building something ground up and have the satisfaction of seeing your product being used and paid for by thousands of customers. You will be a part of a growth story be it anywhere - Sales, Software Development, Marketing, HR, Accounting etc. 

We believe in a culture of openness, innovation & great memories together. 


Are you ready for the ride? 

Find what interesting things you could do with us. 


About the Backend Engineer role

Responsibilities (not exhaustive)


  • Design, write and deliver highly scalable, reliable and fault tolerant systems with minimal guidance 
  • Participate in code and design reviews to maintain our high development standards
  • Partner with the product management team to define and execute the feature roadmap
  • Translate business requirements into scalable and extensible design
  • Proactively manage stakeholder communication related to deliverables, risks, changes and dependencies
  • Coordinate with cross functional teams (Mobile, DevOps, Data, UX, QA etc.) on planning and execution
  • Continuously improve code quality, product execution, and customer delight
  • Willingness to learn new languages and methodologies
  • An enormous sense of ownership
  • Engage in service capacity and demand planning, software performance analysis, tuning and optimization


The Ideal Candidate

 

Education

  • Degree in Computer Science or equivalent with 5+ years of experience in commercial software development in large distributed systems

Experience

  • Hands-on experience in designing, developing, testing and deploying applications on Golang, Ruby,Python, .Net Core or Java for large scale applications
  • Deep knowledge of Linux as a production environment
  • Strong knowledge of data structures, algorithms, distributed systems, and asynchronous architectures
  • Expert in at least 1 of the following languages: Golang, Python, Ruby, Java, C, C++
  • Proficient in OOP, including design patterns. 
  • Ability to design and implement low latency RESTful services
  • Hands-on coder who has built backend services that handle high volume traffic.
  • Strong understanding of system performance and scaling
  • Possess excellent communication, sharp analytical abilities with proven design skills, able to think critically of the current system in terms of growth and stability
  • Data modeling experience in both Relational and NoSQL databases
  • Continuously refactor applications to ensure high-quality design
  • Ability to plan, prioritize, estimate and execute releases with good degree of predictability
  • Ability to scope, review and refine user stories for technical completeness and to alleviate dependency risks
  • Passion for learning new things, solving challenging problems
  • Ability to get stuff done!


Nice to have

  • Familiarity with Golang ecosystem
  • Familiarity with running web services at scale; understanding of systems internals and networking are a plus
  • Be familiar with HTTP/HTTPS communication protocols.

Abilities and Traits

  • Ability to work under pressure and meet deadlines
  • Ability to provide exceptional attention to details of the product.
  • Ability to focus for extended periods of repetitious activity.
  • Ability to think ahead and anticipate problems, issues and solutions
  • Work well as a team player and help the team members to resolve issues
  • Be committed to quality and be structured in approach
  • Excellent and demonstrable concept formulation, logical and analytical skills
  • Excellent planning, organizational, and prioritization skills

 

Location - Chennai - India


Join our team and let's groove together to the rhythm of innovation and opportunity!




Your Buddy

Tazapay



Read more
Quantum Leap Learning Solutions
Sheshadripuram
1 - 8 yrs
₹4L - ₹14L / yr
Bubble.io

The ideal candidate will be responsible for developing high-quality applications using Bubble.io, you will also be responsible for designing and implementing testable and scalable code.

Responsibilities

  • Develop quality software and web applications using Bubble.io
  • Accurately translate and interpret UI/UX designs from Figma into bubble.io including the configuration of responsive design parameters .
  • Analyze and maintain existing software and Bubble.io applications
  • Design highly scalable, testable code maintainable and well-documented Bubble.io applications
  • Discover and fix programming bugs
  • Extend Bubble.io front end capacity with custom HTML ,CSS, javascript
  • Extend bubble.io's backend capacity by implementing plugins , API connections


Qualifications

  • Bachelor's degree or equivalent experience in Computer Science or related field
  • Development experience with programming languages
  • Short course or equivalent experience with backend development languages (HTML, CSS , javascript)
  • Short courses or equivalent experience with back-end development languages (e.g. NodeJS, Python)
  • Short courses or equivalent experience working with databases (SQL, NoSQL) and APls.

Experience

•   Over 6 months full-time experience working with Bubble.io (you will be required to show your portfolio of work of demonstrating a deep knowledge of Bubble during the process)

•   One or more years of experience designing, implementing and maintaining Relational Databases

•   One or more years of experience building web applications (any language) or work in a technical business analyst or product leadership role

•   Client facing experience is highly regarded


Note: This is a full-time role based in Bangalore and will require you to work from the office.


Websites: www.rajivtalreja.com www.karanhasija.com www.quantumleap.co.in

Read more
Jio Platforms Limited
at Jio Platforms Limited
3 recruiters
Dixit Nahar
Posted by Dixit Nahar
Navi Mumbai, Mumbai
3 - 5 yrs
₹9L - ₹15L / yr
skill iconPython
TensorFlow
Keras
Apache Kafka
Spark
+7 more
Role - Data Scientist / Machine Learning Scientist / Deep Learning Engineer -: 3 - 5 yrs experienced Programming Must Know:- Python, Tensorflow, Keras, Kafka, Spark Must have worked in Video Analytics with at least 2 Deep Learning Models like R-CNN, LSTM, Object Detection Models like YOLO, Object tracking Models like Deep SORT Must have good model training and testing experience with Structured(statistical machine learning) and Unstructured Data Must be good with Statistics. Good to have Data visualization experience in Python or any data visualization tool. Good to have Kubernetes, Multiprocessing experience, MLops like docker, hydra etc

Team:- We are a team of 9 data scientists working on Video Analytics Projects, Data Analytics projects for internal AI requirements of Reliance Industries as well for the external business. At a time, we make progress on multiple projects(atleast 4) in Video Analytics or Data Analytics.
Read more
Nirvana Infomedia
at Nirvana Infomedia
1 recruiter
Shivani Saxena
Posted by Shivani Saxena
Remote only
0 - 1 yrs
₹1L - ₹1L / yr
Human Resources (HR)
Communication Skills
Team Management
We are Nirvana Infomedia, a dehradun based digital marketing and E-learning agency. We are looking for a good intern with excellent communication and management skills who can work for us for the HR Post. 

Stipend will be based on the performance.
Read more
Ebizz Infotech
at Ebizz Infotech
3 recruiters
Alpa Kher
Posted by Alpa Kher
Surat
1 - 4 yrs
₹1.8L - ₹4L / yr
skill iconFlutter
DART
Firebase
Mobile App Development
MySQL

Job Description :

 

- Collaborate with cross-functional teams to define, design, and ship new features.

 

- Work with outside data sources and APIs.

 

- Worked on Dart.js

 

- Unit-test code for robustness, including edge cases, usability, and general reliability

 

- Work on bug fixing and improving application performance

 

- Continuously discover, evaluate, and implement new technologies to maximize development efficiency.

 

Responsibilities And Duties :

 

- Must have built at least one Android, iOS, apps with Flutter or Hybrid Framework.

Read more
Duplex Technologies Services
Priyanka Mishra
Posted by Priyanka Mishra
aliganj Lucknow, Lucknow
0 - 3 yrs
₹1L - ₹3L / yr
skill iconAndroid Development
RESTful APIs
skill iconXML
JSON
User Interface (UI) Design
Required Experience, Skills and Qualifications Strong knowledge of Android SDK, different versions of Android, and how to deal with different screen sizes Familiarity with RESTful APIs to connect Android applications to back-end services Strong knowledge of Android UI design principles, patterns, and best practices Experience with offline storage, threading, and performance tuning Ability to design applications around natural user interfaces, such as “touch” Familiarity with the use of additional sensors, such as gyroscopes and accelerometers Knowledge of the open-source Android ecosystem and the libraries available for common tasks Ability to understand business requirements and translate them into technical requirements Familiarity with cloud message APIs and push notifications A knack for benchmarking and optimization Understanding of Google’s Android design principles and interface guidelines Proficient understanding of code versioning tools, such as Git Familiarity with continuous integration
Read more
Skylark Drones
at Skylark Drones
11 recruiters
Vaibhav Srinivasa
Posted by Vaibhav Srinivasa
Bengaluru (Bangalore)
2 - 4 yrs
₹12L - ₹16L / yr
skill iconPython
skill iconJavascript
Fullstack Developer
Web Development
skill iconDjango
+3 more

Job description

We are looking for an experienced full stack developer, comfortable with both frontend and backend programming. You will be responsible for the development and maintenance of our web applications across the three products - Spectra, Drone Mission Ops and DronePass.

Spectra: An integrated drone data platform to visualize enterprise worksites and perform AI-powered analytics that helps teams plan better, construct faster, and sustain longer.

 

Drone Mission Ops (DMO): A full-stack drone flight solution that enables drone service providers, pilots, and enterprises to execute fast, accurate, and seamless drone missions

DronePass: Hardware module and integration solution that helps drone manufacturers, OEMs, and system integrators integrate their drones with Digital Sky for Unmanned Traffic Management.

Responsibilities

  1. Build and deploy new tools to streamline the overall process flow as requirements develop

  2. Explore new technologies and products to see how they can improve our products

  3. Translate business requirements into technical specifications; communicate and get

    stakeholder buy-in; iterate and refine

  4. Review, prepare and present design/code to colleagues

  5. Coordinating with the extended development team and cross-functional teams

Skillset

Must have

  1. Proficiency with JavaScript and Python

  2. 2+ years experience working on web applications (building, maintaining and debugging)

  3. 2+ years experience working with either Django or Flask framework

  4. 2+ years experience working with either VueJS or React framework

  5. Experience with databases such as PostgreSQL or MySQL or MongoDB

  6. Experience in design and implementation of ReST APIs

  7. Proficiency with Git version control

Good to have

  1. Knowledge of TypeScript

  2. Knowledge of GraphQL and PostGIS

  3. Knowledge in test-driven development: unit tests and integration tests

  4. Experience with deployment tools such as Docker and CI/CD

  5. Experience with cloud services such as AWS or GCP

  6. Experience with map-related libraries such as GDAL, Geopandas, MapBox, Leaflet etc.

Read more
Unified Communications and Network Services. (C1)
Unified Communications and Network Services. (C1)
Agency job
via Multi Recruit by Ragul Ragul
Bengaluru (Bangalore)
7 - 10 yrs
₹12L - ₹15L / yr
Operation Mangement
Escalation management
Ticket Logging
Operations Management
Escalation Management

Call Reception and Ticket Logging: Responsible for:

  • Ensuring calls are answered professionally
  • Ensuring that the relevant information is collected from a customer
  • Ensuring that the correct level of priority is agreed with the customer
  • Ensuring that the ticket is assigned to the correct engineer
  • Ensuring that the engineer is aware that there is a new ticket assigned to their queue

    SLA Management: Responsible for:
  • Ensuring that appropriate attention is paid to P1s
  • TPMs engaged immediately for engineer dispatch to the site where applicable
  • The customer is forwarded to an engineer for a possible remote fix
  • Ensuring that all tickets are managed in line with SLAs

    Jeopardy Management: Responsible for:
  • Ensuring that the ticket is managed in line with Company’s jeopardy management process

    Escalation Management: Responsible for:
  • Ensuring that the ticket is escalated appropriately in line with Company’s escalation process
  • Provide 1st line escalation to customers and channels (referring to Jeopardy and Escalation Manager)
  • Provide 1st line escalation into TPM (referring to Jeopardy and Escalation Manager)
  • Responsible for advising Service Centre Manager of any missing information in the knowledge database

    Communication Responsible for:
  • Customer Communication
  • Ensuring that the customer is updated regularly throughout the duration of the ticket
  • Ensuring the quality of ticket input is of a high standard
  • Ensuring that key internal contacts are advised of any issues
  • Responsible for reading, understanding, and complying with Company’s Information Security policies.

FORMAL EDUCATION AND TRAINING

  • Educated to an A-level minimum, with higher education qualification (degree or equivalent preferred). Alternatively, relevant and proven Industry experience would be accepted
  • Industry or relevant business qualifications and accreditations would be desirable
  • Proficiency involved in working in the service industry, with particular emphasis placed on customer focus issues.
  • Ability to form close working relationships with the customer community, sub-contractors
  • Excellent client-facing communications skills
  • A Self-motivated team player with excellent interpersonal skills
  • An outgoing individual willing to participate as part of a small and flexible team
  • in European languages would be an advantage
  • ITIL Foundation / ITIL v3 Foundation
  • Overall telecommunications knowledge with an appreciation of the Nortel / Avaya / Genesys / AWS Product Sets

 

Key Competencies

  • Customer Focused
  • Relationship Building and Maintenance
  • Decision-Making Ability
  • Inspiring Communicator
  • Initiating Action
  • Personal Responsibility
Read more
Ezyhaul
Agency job
via Mango Consulting by Reshma Injapuram
Bengaluru (Bangalore)
4 - 8 yrs
₹7L - ₹12L / yr
skill iconJavascript
skill iconNodeJS (Node.js)
skill iconAngular (2+)
skill iconGit
TypeScript

 Duties and Responsibilities                        

  • Participate in requirements
  • Maintain and improve web Design mobile-based web features.
  • Work closely with Scrum team to ensure quality throughout the entire software development
  • Maintain high standards of software quality by establishing, adopting and following good practices and processes
  • Monitor systems to ensure they meet both customer needs and business goals
  • Solve problems by crafting software solutions using maintainable, testable and modular code
  • Collaborate within a team by participating in code reviews, pairing sessions, architecture discussions and planning

  • Write robust, testable code, along with unit, functional, acceptance and/or user tests to validate every change
  • Challenge your fellow team members to grow and enhance our team with new, diverse talent
  • Mentor interns and other software engineers to grow their technical skills
  • Work closely with Scrum team to ensure quality throughout the entire software development cycle.
  • Identify and propose dev toolsets to enhance and extend the dev team’s capabilities & efficiency
  • Manage business context and pressures around quality and time to market
  • Stay up-to-date on emerging technologies
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos