Cutshort logo
Inncircles  logo
Sr. Big Data Engineer
Sr. Big Data Engineer
Inncircles 's logo

Sr. Big Data Engineer

Gangadhar M's profile picture
Posted by Gangadhar M
3 - 5 yrs
Best in industry
Hyderabad
Skills
PySpark
Spark
skill iconPython
ETL
Amazon EMR
Amazon S3
SQL
NOSQL Databases
athena
Apache Kafka
Apache Spark
skill iconMongoDB


We are looking for a highly skilled Sr. Big Data Engineer with 3-5 years of experience in

building large-scale data pipelines, real-time streaming solutions, and batch/stream

processing systems. The ideal candidate should be proficient in Spark, Kafka, Python, and

AWS Big Data services, with hands-on experience in implementing CDC (Change Data

Capture) pipelines and integrating multiple data sources and sinks.


Responsibilities

  • Design, develop, and optimize batch and streaming data pipelines using Apache Spark and Python.
  • Build and maintain real-time data ingestion pipelines leveraging Kafka and AWS Kinesis.
  • Implement CDC (Change Data Capture) pipelines using Kafka Connect, Debezium or similar frameworks.
  • Integrate data from multiple sources and sinks (databases, APIs, message queues, file systems, cloud storage).
  • Work with AWS Big Data ecosystem: Glue, EMR, Kinesis, Athena, S3, Lambda, Step Functions.
  • Ensure pipeline scalability, reliability, and performance tuning of Spark jobs and EMR clusters.
  • Develop data transformation and ETL workflows in AWS Glue and manage schema evolution.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and high-quality data solutions.
  • Implement monitoring, logging, and alerting for critical data pipelines.
  • Follow best practices for data security, compliance, and cost optimization in cloud environments.


Required Skills & Experience

  • Programming: Strong proficiency in Python (PySpark, data frameworks, automation).
  • Big Data Processing: Hands-on experience with Apache Spark (batch & streaming).
  • Messaging & Streaming: Proficient in Kafka (brokers, topics, partitions, consumer groups) and AWS Kinesis.
  • CDC Pipelines: Experience with Debezium / Kafka Connect / custom CDC frameworks.
  • AWS Services: AWS Glue, EMR, S3, Athena, Lambda, IAM, CloudWatch.
  • ETL/ELT Workflows: Strong knowledge of data ingestion, transformation, partitioning, schema management.
  • Databases: Experience with relational databases (MySQL, Postgres, Oracle) and NoSQL (MongoDB, DynamoDB, Cassandra).
  • Data Formats: JSON, Parquet, Avro, ORC, Delta/Iceberg/Hudi.
  • Version Control & CI/CD: Git, GitHub/GitLab, Jenkins, or CodePipeline.
  • Monitoring/Logging: CloudWatch, Prometheus, ELK/Opensearch.
  • Containers & Orchestration (nice-to-have): Docker, Kubernetes, Airflow/Step
  • Functions for workflow orchestration.


Preferred Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
  • Experience in large-scale data lake / lake house architectures.
  • Knowledge of data warehousing concepts and query optimisation.
  • Familiarity with data governance, lineage, and cataloging tools (Glue Data Catalog, Apache Atlas).
  • Exposure to ML/AI data pipelines is a plus.


Tools & Technologies (must-have exposure)

  • Big Data & Processing: Apache Spark, PySpark, AWS EMR, AWS Glue
  • Streaming & Messaging: Apache Kafka, Kafka Connect, Debezium, AWS Kinesis
  • Cloud & Storage: AWS (S3, Athena, Lambda, IAM, CloudWatch)
  • Programming & Scripting: Python, SQL, Bash
  • Orchestration: Airflow / Step Functions
  • Version Control & CI/CD: Git, Jenkins/CodePipeline
  • Data Formats: Parquet, Avro, ORC, JSON, Delta, Iceberg, Hudi
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Inncircles

Founded :
2019
Type :
Product
Size :
100-500
Stage :
Profitable

About

Inncircles Arena – a Modern Construction Management Platform, is a composed one stop solution for construction management that is highly configurable, easily adaptable, data centric while leveraging advanced artificial intelligence and cloud technologies to ramp up construction company's digital transformation initiatives. It empowers construction teams to go beyond the tactical to strategic. Through the platform, residential, industrial and infrastructure construction companies gain real-time insights into their projects, a unified communication and collaboration space, powerful configuration capabilities to integrate with existing or legacy tools and technologies. Detailed products and solution packages allow for planning, scheduling, assigning, tracking, and analyzing construction work packages from pre-planning stage to handover. Solving Construction Business Challenges through Technology • Work Management: Elevate efficiency and transform project management by scheduling works, tracking progress while gaining real-time insights. • Quality Management: Ensure projects meet the required quality standards by performing regular inspections and issue tracking. • Safety Management: Record and monitor safety incidents in real-time, schedule inspections, and store pertinent safety documentation. • Advanced Work Package (AWP): Build package of works, schedule work packages and monitor progress. • Data and Analytics: Gain profound insights of projects through visually stunning dashboards that bring your data to life. • Mobile Application: Offer mobile accessibility to enable field teams to access information, submit updates, and communicate in real-time, improving overall efficiency. • Integrations: Foster connectivity in the construction eco system with Arenas potent integration capabilities. • Pre-Construction Planning: Drive project planning, budgeting, estimating, bidding, and collaboration during the pre-construction phase. • Procurement: Create procurement packages
Read more

Company social profiles

linkedin

Similar jobs

Moshi Moshi
at Moshi Moshi
3 candid answers
Human Resource
Posted by Human Resource
Bengaluru (Bangalore)
1 - 5 yrs
₹3.6L - ₹4.5L / yr
Sales
Real Estate
cold calling
Presales

Role Summary:

We are seeking a proactive and persuasive Telecaller to join our fast paced real estate team. The candidate will be responsible for contacting potential buyers, understanding their property requirements, providing relevant information, and scheduling site visits. The goal is to convert

leads into prospects and contribute to the company’s sales pipeline.


Key Responsibilities:

• Make outbound calls to potential clients based on leads provided.

• Understand customer requirements and provide relevant property information.

• Systematic follow-up with interested leads and timely updates on new offers.

• Schedule and coordinate site visits with sales teams and clients.

• Maintain accurate records of all conversations and lead progress using CRM tools.

• Achieve daily/weekly/monthly targets for calls and conversions.

• Handle customer inquiries professionally and escalate issues when needed.

Whatsapp blast and email marketing to be carried out.

Job Specification (JS):

Education qualifications:

• Minimum preferred: Bachelor’s degree in any field.


Experience:

• 2-3+ years of experience in telecalling, telesales, or customer support.

• Experience in real estate or similar industry is an added advantage.


Skills & Competencies:

• Excellent verbal communication skills in English and local & regional specific languages (Hindi, Kannada & Tamil).

• Good convincing and negotiation skills.

• Confident, energetic, and customer-focused.

• Ability to handle rejection and remain calm under pressure.

• Basic computer knowledge and experience with MS Office.


Other Requirements:

• Willing to work in a target-driven environment.

• Must be comfortable with working on weekends and fixed weekday offs (as per company’s norms).

Read more
Eclat Engineering Pvt Ltd
Ahmedabad
3 - 6 yrs
₹4L - ₹6.5L / yr
Recruitment/Talent Acquisition
Employee Engagement
Communication Skills
Human Resources (HR)

About The Role The Senior Talent Acquisition Specialist will own the complete recruitment process and drive strategic hiring initiatives to meet, build, and forecast the organization's talent needs while also collaborating with the HR team to enhance the eNPS score.

What Describes You Best

  • Bachelor’s/Master’s degree in Business/HR (mandatory)/Psychology
  • Minimum 3-5 years of experience in hiring, preferably in the IT industry
  • Experience of using ATS and other recruitment software
  • Prior experience in hiring for a Product SaaS-based startup
  • Knowledge of national employee and labor laws

Skills

  • Excellent written and spoken English skills
  • Excellent interpersonal and communication skills with the ability to build strong relationships with candidates and internal stakeholders
  • Experience in hiring multiple tech and non-tech roles (business analyst, AI/Ml engineer, data scientist, Sales roles etc )
  • ability to map, search, and filter appropriate candidates from multiple sources, combined with a strong understanding of technical skills, terminologies, and roles.
  • Strong analytical skills with the ability to leverage data to drive decisions
  • Ability to work independently, prioritize tasks, and manage multiple deadlines , keep all stakeholders informed of current industry and hiring trends
  • Knowledge of Microsoft office suite and Google suite

Additional Skills: (nice to have) Experience in hiring managerial positions Experience with HRMS software, e.g KEKA, BambooHR, etc HR certifications (SHRM, CIPD) Experience in HR operations (Payroll, attendance ) Experience working with OKRs

What will you own As a Sr. Talent Acquisition Specialist, you will take complete ownership of the entire recruitment process focusing on sourcing, attracting, and hiring top talent that aligns with the values and goals of the organization. Additionally, you will also be actively responsible for creating and driving employer branding initiatives and assist in other HR activities.

**How will you spend your time at Eclat **

  • Own end-to-end Recruitment process and drive strategic hiring initiatives to forecast and meet the organization's talent needs in collaboration with all stakeholders e.g. Functional heads and hiring managers.
  • Engage potential candidates through various channels, promoting the company’s values, culture, perks, and employer brand to ensure a positive candidate experience.
  • Utilize HR analytics to drive improvements in HR strategies and recruitment processes by staying informed on the latest talent market trends.
  • Manage and maintain accurate candidate records in terms of interviews, feedback and recruitment metrics such as Offer to Joining ratio, Drop out figures, etc
  • Collaborate and participate in other HR activities to positively enhance the eNPS score.

Why Join Us

  • Be a part of our growth story as we aim to take a leadership position in international markets
  • Opportunity to manage and lead global teams and channel partner network
  • Join technology innovators who believe in solving world-scale challenges to drive global knowledge-sharing
  • Healthy work/life balance, offering wellbeing initiatives, parental leave, career development assistance, required work infrastructure support


Read more
Lam Research
Agency job
via hRINPUTS by RAHUL BATTA
Bengaluru (Bangalore)
5 - 8 yrs
₹25L - ₹28L / yr
skill iconAngularJS (1.x)
skill iconAngular (2+)
ThreeJs (Three.js)
fabric.js
two.js
+2 more

Eligibility Criteria: • Years of Experience: 5-8 years on software development •

Educational Qualification: Bachelor’s degree in engineering Job Summary:

• We're seeking an experienced Angular Developer to join our team. The ideal candidate will have a strong background in developing scalable, efficient, and high-quality applications using Angular. The candidate will be responsible for handling projects, understanding requirements, and delivering solutions that meet our high standards. Primary Responsibilities:

• Design, develop, test, and deploy applications using Angular. • Collaborate with cross-functional teams to define, design, and ship new features.

• Translate requirements into technical specifications and implement solutions.

• Write clean, maintainable, and efficient code that adheres to our coding standards.

• Understand and assess requirements delivered by Product Owner. • Implement and integrate image processing libraries such as Fabric.js, Two.js, and Three.js.

• Create and manage interactive charts using libraries like Plotly and D3.js.

• Implement complex image processing algorithms and integrate image editing tools.

• Optimize application performance and ensure high-quality user experiences.

• Implement CI/CD pipelines on Azure to streamline development processes.

• Troubleshoot and resolve issues in a timely manner. Mandatory Skills: • 5-8 years of experience in Angular development.

• Solid understanding of web development fundamentals (HTML, CSS, JavaScript).

• Proficiency in image processing libraries such as Fabric.js, Two.js, and Three.js.

• Strong experience with charting libraries like Plotly and D3.js. • Excellent problem-solving skills and debugging techniques. • Strong communication and collaboration skills.

• Capable of independently handling and efficiently overseeing projects.

• Hands-on experience with CI/CD pipelines on Azure. • Team oriented personality with excellent interpersonal and communication skills. Desirable Skills:

• Knowledge of Node.js • Knowledge with Azure cloud platform. Req ID: • Experience in using UI mock-up creation software’s • Canvas and SVG Designing. •

Knowledge on Semiconductor equipment industry. • Knowledge of containerization using Docker. • Familiarity with databases such as MongoDB or MySQL. •

Familiarity with agile development methodologies. What We Offer: • Competitive salary and benefits package.

• Opportunity to work on challenging projects and contribute to our company's growth. •

Collaborative and dynamic work environment. • Professional development opportunities and training.

• Flexible working hours and remote work options. If you're a motivated and talented Angular and Node Developer looking for a new challenge, please submit your application, including your resume and a brief cover letter

Read more
Celebal Technologies Pvt Ltd
at Celebal Technologies Pvt Ltd
2 candid answers
Anjani Upadhyay
Posted by Anjani Upadhyay
Jaipur
3 - 6 yrs
₹10L - ₹15L / yr
ETL
Informatica
Data Warehouse (DWH)
SQL
NOSQL Databases
+6 more

Job Description: 

An Azure Data Engineer is responsible for designing, implementing, and maintaining pipelines and ETL/ ELT flow solutions on the Azure cloud platform. This role requires a strong understanding of migration database technologies and the ability to deploy and manage database solutions in the Azure cloud environment.

 

Key Skills:

·      Min. 3+ years of Experience with data modeling, data warehousing, and building ETL pipelines.

·      Must have a firm knowledge of SQL, NoSQL, SSIS SSRS, and ETL/ELT Concepts.

·      Should have hands-on experience in Databricks, ADF (Azure Data Factory), ADLS, Cosmos DB.

·      Excel in the design, creation, and management of very large datasets

·      Detailed knowledge of cloud-based data warehouses, architecture, infrastructure components, ETL, and reporting analytics tools and environments.

·      Skilled with writing, tuning, and troubleshooting SQL queries

·      Experience with Big Data technologies such as Data storage, Data mining, Data analytics, and Data visualization.

·      Should be familiar with programming and should be able to write and debug the code in any of the programming languages like Node, Python, C#, .Net, Java.

 

Technical Expertise and Familiarity:

  • Cloud Technologies: Azure (ADF, ADB, Logic Apps, Azure SQL database, Azure Key Vaults, ADLS, Synapse)
  • Database: CosmosDB, Document DB  
  • IDEs: Visual Studio, VS Code, MS SQL Server
  • Data Modelling,ELT, ETL Methodology

 

 

 

 

 

 

Read more
Remote only
3 - 5 yrs
₹4L - ₹9L / yr
Articulate Storyline
E-learning
SCORM
Learning Management System (LMS)
Content Strategy
+1 more

Instructional Designer (Full time, Permanent WFH, Flexible Timing)

 

What you will do at Xclaymation:

  • Should showcase core competencies in LMS, SCORM and other authoring tools and actively apply them on a day-to-day basis.
  • Be on the lookout regularly on how to give the best makeovers to drab information that captivates people and holds them in place for a few seconds more.
  • Develop e2e LMS modules from conceptualization to support.
  • Attend regular meetings with our clients and understand their needs and specifications to better cater the modules to them.
  • Be part of a team that doesn’t believe in managers and hierarchies, but in collaborative functioning and reap the benefits of flex hours.

 

Skills we are looking for -

  • Content developer
  • eLearning developer
  • Training and development associate
  • Articulate Storyline
Read more
MindHind
Vanish Jain
Posted by Vanish Jain
Remote only
4 - 6 yrs
₹8L - ₹12L / yr
skill iconPHP
MySQL
skill iconLaravel
skill iconCodeIgniter
PHP DEVELOPER:

  • Willing to contribute to Small or Large Project Teams
  • Must be willing to start Immediately work from home permanent
  • Good Communication Skills (English)
  • Can Allocate working hours (Flexible) as per Projects Req
  • Must have Good Internet & Good Laptop/System
Read more
A leading Indian IT major hiring for a leading insurance client
A leading Indian IT major hiring for a leading insurance client
Agency job
via Indventur Partner by Vanshika kaur
Chennai
5 - 9 yrs
₹15L - ₹20L / yr
IT infrastructure
IBM Director
EMC
ECS
Oracle DBA

Job Location: Chennai

Client: A leading Indian IT major hiring for a leading insurance client

Experience: 5-9 Years

Primary skills: Filenet

Secondary Skill: IBM FileNet Capture/Oracle DBA/

Domain Skill: Technical Lead File Net

Detailed Job Description: 

  • Overall 3-6 years of experience in IT. 
  • Strong understanding of Application admin / Software Development Life Cycle 
  • ability to work with a technical team to meet sure deliverables everyday. 
  •  Must have 1-2 years of an experience in working in IBM FileNet, IBM Data Capture, Oracle DB 
  •  Prefer to have 1-2 years of experience WAS, HA Configuration, Cantera storage & EMC ECS storage. 
  • Must stay current on IBM, Windows, WAS… versions. 
  • must have experience in managing workflow having API CALLs & Documaker to FileNET 
  • having support experience dealing with interfaces from internal and external sources. 
  • should be able to do deployment to production 
  •  Applying patches to production with the GIT technical team. 
  •  Excellent communication skills 
  • Willing to work in 24x7 Shifts
Read more
Olive crypto
at Olive crypto
7 recruiters
Srinivas Marepalli
Posted by Srinivas Marepalli
Hyderabad, Mumbai
0 - 3 yrs
₹2.5L - ₹6L / yr
Linux administration
Apache Tomcat
Databases
Linux/Unix
Oracle
+2 more
  • Working with Banks in 24x7 based environment and identify Application problems and advising on the solution.
  • Analyzing application/OS logs to spot common trends and underlying problems.
  • Analyzing underlying database using SQL queries (MS SQL /Oracle or any other relational database).
  • Deploying, testing, and reporting bugs/issues in new modules and support clients in testing.

Skills Required:

  • Good analytical and problem-solving skills.
  • knowledge of Linux Commands and database queries.
  • Knowledge of Application servers i.e Apache Tomcat/ Jboss.
  • Knowledge of shell script 
  • knowledge on Banking Digital Products i.e. IMPS, UPI
Read more
Cloud infrastructure solutions and support company. (SE1)
Cloud infrastructure solutions and support company. (SE1)
Agency job
via Multi Recruit by Ranjini A R
Bengaluru (Bangalore)
5 - 10 yrs
₹16L - ₹20L / yr
SOAP
REST
JSON
skill iconXML
skill iconAndroid Development
+2 more
  • 5-7 years of experience on Android Java-based mobile applications and systems development
  • Strong command of Android Java. Exposure towards Android SDK
  • Strong knowledge of the various packages on the Android App development stack layouts, intents, widgets, content providers, touch handling, drawing, location services, media interfaces, network, storage, security/cryptography, SQLite, etc.
  • Knowledge of web services and serialization techniques like REST, SOAP, XML, JSON & framing
  • A strong penchant for Object-Oriented Design and CS fundamentals
  • Experience in working with version control, bug tracking, continuous integration, and other productivity enhancement software like TFS, Bugzilla, Jira, etc.
  • Prior experience in working in Agile software methodologies
  • Taking responsibility and ownership in the team's work, team player, and good communication skills
  • Hands-on experience in developing native Android applications.
  • Understanding of Android design patterns, memory management, file I/O, concurrency, and multithreading.
  • Knowledge of working with network & battery optimizations, APIs, external libs, SDKs, Analytics, UI, visualizations & animations
  • Preferred knowledge on Connectivity, Bluetooth protocols/ BLE.
  • Working knowledge and hands-on with Database management such as SQL and contemporary technologies at their backend
  • Experience in Unit Testing and TDD practices. Usage of Junit/Mockito/Espresso kind of test frameworks
  • Eclipse or any IDE usage
  • Published one or more applications in an Android marketplace and knowledge on the process of making the app live.
  • Experience in working on applications with react native is a plus.
  • Able to create a UI and UX that would make the app simple to use and delight users.
  • Able to fix the occurring bugs and iteratively improve the app, include newer features, and keep the app up to date with all the Android updates/ libraries that will be released.
  • Have an eye for new upcoming technologies and be able to evaluate and implement the same to enhance development efficiency.
  • To succeed in this role, you should have the following skills and experience
  • B.E/B.Tech/M.Tech/MCA or equivalent qualification
Read more
Mitsify Web Development LLP
Deepan Prabhu
Posted by Deepan Prabhu
Villivakkam
0 - 2 yrs
₹1L - ₹2L / yr
Business Development
Sales
Client Servicing
Presales
Proposal writing
Job Summary Looking for young energetic business executive Skills: -Should have good knowledge in software to understand the products -Should have strong knowledge and capability to understand client needs to suggest them with better solution for their business -Should be capable of achieving target and handling pressure -Should be capable of biding projects online -Should be capable of sending proposal and creating company profile Educational Qualification : Any Bachelor's Degree Job Type: Full-time Salary: ₹10,000.00 to ₹15,000.00 /month
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos