Cutshort logo
Inncircles  logo
Sr. Big Data Engineer
Sr. Big Data Engineer
Inncircles 's logo

Sr. Big Data Engineer

Gangadhar M's profile picture
Posted by Gangadhar M
3 - 5 yrs
Best in industry
Hyderabad
Skills
PySpark
Spark
skill iconPython
ETL
Amazon EMR
Amazon S3
SQL
NOSQL Databases
athena
Apache Kafka
Apache Spark
skill iconMongoDB


We are looking for a highly skilled Sr. Big Data Engineer with 3-5 years of experience in

building large-scale data pipelines, real-time streaming solutions, and batch/stream

processing systems. The ideal candidate should be proficient in Spark, Kafka, Python, and

AWS Big Data services, with hands-on experience in implementing CDC (Change Data

Capture) pipelines and integrating multiple data sources and sinks.


Responsibilities

  • Design, develop, and optimize batch and streaming data pipelines using Apache Spark and Python.
  • Build and maintain real-time data ingestion pipelines leveraging Kafka and AWS Kinesis.
  • Implement CDC (Change Data Capture) pipelines using Kafka Connect, Debezium or similar frameworks.
  • Integrate data from multiple sources and sinks (databases, APIs, message queues, file systems, cloud storage).
  • Work with AWS Big Data ecosystem: Glue, EMR, Kinesis, Athena, S3, Lambda, Step Functions.
  • Ensure pipeline scalability, reliability, and performance tuning of Spark jobs and EMR clusters.
  • Develop data transformation and ETL workflows in AWS Glue and manage schema evolution.
  • Collaborate with data scientists, analysts, and product teams to deliver reliable and high-quality data solutions.
  • Implement monitoring, logging, and alerting for critical data pipelines.
  • Follow best practices for data security, compliance, and cost optimization in cloud environments.


Required Skills & Experience

  • Programming: Strong proficiency in Python (PySpark, data frameworks, automation).
  • Big Data Processing: Hands-on experience with Apache Spark (batch & streaming).
  • Messaging & Streaming: Proficient in Kafka (brokers, topics, partitions, consumer groups) and AWS Kinesis.
  • CDC Pipelines: Experience with Debezium / Kafka Connect / custom CDC frameworks.
  • AWS Services: AWS Glue, EMR, S3, Athena, Lambda, IAM, CloudWatch.
  • ETL/ELT Workflows: Strong knowledge of data ingestion, transformation, partitioning, schema management.
  • Databases: Experience with relational databases (MySQL, Postgres, Oracle) and NoSQL (MongoDB, DynamoDB, Cassandra).
  • Data Formats: JSON, Parquet, Avro, ORC, Delta/Iceberg/Hudi.
  • Version Control & CI/CD: Git, GitHub/GitLab, Jenkins, or CodePipeline.
  • Monitoring/Logging: CloudWatch, Prometheus, ELK/Opensearch.
  • Containers & Orchestration (nice-to-have): Docker, Kubernetes, Airflow/Step
  • Functions for workflow orchestration.


Preferred Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
  • Experience in large-scale data lake / lake house architectures.
  • Knowledge of data warehousing concepts and query optimisation.
  • Familiarity with data governance, lineage, and cataloging tools (Glue Data Catalog, Apache Atlas).
  • Exposure to ML/AI data pipelines is a plus.


Tools & Technologies (must-have exposure)

  • Big Data & Processing: Apache Spark, PySpark, AWS EMR, AWS Glue
  • Streaming & Messaging: Apache Kafka, Kafka Connect, Debezium, AWS Kinesis
  • Cloud & Storage: AWS (S3, Athena, Lambda, IAM, CloudWatch)
  • Programming & Scripting: Python, SQL, Bash
  • Orchestration: Airflow / Step Functions
  • Version Control & CI/CD: Git, Jenkins/CodePipeline
  • Data Formats: Parquet, Avro, ORC, JSON, Delta, Iceberg, Hudi
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Inncircles

Founded :
2019
Type :
Product
Size :
100-500
Stage :
Profitable

About

Inncircles Arena – a Modern Construction Management Platform, is a composed one stop solution for construction management that is highly configurable, easily adaptable, data centric while leveraging advanced artificial intelligence and cloud technologies to ramp up construction company's digital transformation initiatives. It empowers construction teams to go beyond the tactical to strategic. Through the platform, residential, industrial and infrastructure construction companies gain real-time insights into their projects, a unified communication and collaboration space, powerful configuration capabilities to integrate with existing or legacy tools and technologies. Detailed products and solution packages allow for planning, scheduling, assigning, tracking, and analyzing construction work packages from pre-planning stage to handover. Solving Construction Business Challenges through Technology • Work Management: Elevate efficiency and transform project management by scheduling works, tracking progress while gaining real-time insights. • Quality Management: Ensure projects meet the required quality standards by performing regular inspections and issue tracking. • Safety Management: Record and monitor safety incidents in real-time, schedule inspections, and store pertinent safety documentation. • Advanced Work Package (AWP): Build package of works, schedule work packages and monitor progress. • Data and Analytics: Gain profound insights of projects through visually stunning dashboards that bring your data to life. • Mobile Application: Offer mobile accessibility to enable field teams to access information, submit updates, and communicate in real-time, improving overall efficiency. • Integrations: Foster connectivity in the construction eco system with Arenas potent integration capabilities. • Pre-Construction Planning: Drive project planning, budgeting, estimating, bidding, and collaboration during the pre-construction phase. • Procurement: Create procurement packages
Read more

Company social profiles

linkedin

Similar jobs

Xebia IT Architects
Bengaluru (Bangalore), Pune, Hyderabad, Gurugram, Chennai, Jaipur, Bhopal
5 - 14 yrs
₹10L - ₹28L / yr
Xstore
POS
Oracle Retail
Retail
Product Management
+2 more

Role : Product Manager – Oracle Xstore

Work Location : Any Xebia location

Shift timings : 3 PM to 12 AM

Mode of Work : 3 Days work from office


Qualifications:

  • Bachelor’s degree in business, Computer Science, or a related field.
  • 1-2 years of experience in product management or related roles, preferably in the retail technology sector.
  • Strong knowledge of Xstore POS and Oracle applications.
  • Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams.
  • Analytical mindset with experience in data analysis and performance metrics.
  • Passion for technology and a deep understanding of retail operations across US , Canada, and Latin-American markets


Preferred Skills:

  • Familiarity with Agile methodologies.
  • Experience with product management tools (e.g., JIRA, Trello).
  • Understanding of software development processes and lifecycle.


Read more
KCS Technologies
Hyderabad
7 - 15 yrs
₹1L - ₹15L / yr
Sales
IT Sales
ERP Sales
Staffing Sales

Key Responsibilities:

  • Minimum of 7+ years of experience in IT sales.
  • Develop and execute sales strategies to generate new business opportunities and expand client base within the US staffing market.
  • Identify and target potential clients through proactive prospecting, networking, and cold-calling efforts.
  • Build and nurture strong relationships with key decision-makers and stakeholders at client organizations.
  • Understand client staffing needs, requirements, and challenges to provide tailored workforce solutions.
  • Collaborate with internal recruitment teams to align staffing solutions with client demands and expectations.
  • Prepare and deliver compelling sales presentations, proposals, and pitches to prospective clients.
  • Negotiate contract terms, pricing, and service agreements to ensure mutually beneficial outcomes.
  • Monitor market trends, competitor activities, and industry developments to identify opportunities for growth and differentiation.
  • Maintain accurate and up-to-date records of sales activities, client interactions, and revenue forecasts using CRM systems.
  • Meet or exceed sales targets, quotas, and KPIs established by the company.

Qualifications:

  • Bachelor's degree in Business Administration, Sales, Marketing, or related field.
  • Proven track record of success in B2B sales, preferably within the US staffing or recruitment industry.
  • Strong understanding of the US staffing market, including industry trends, client needs, and competitor landscape.
  • Excellent communication, negotiation, and interpersonal skills.
  • Ability to work independently and as part of a team in a fast-paced, target-driven environment.
  • Proficiency in CRM software and Microsoft Office suite.
  • Willingness to travel as needed.


Read more
Qualitas Global QA Labs
Preeti Salvi
Posted by Preeti Salvi
Remote, kharadi, Pune
2 - 5 yrs
₹2L - ₹6L / yr
Content Writing
Search Engine Optimization (SEO)
Google Adwords
Web Analytics
skill iconGoogle Analytics
+3 more

Job Summary
Digital Marketing Executive will work with the Marketing team and be responsible for :
a)To Plan and execute all digital marketing, including SEO/SEM, marketing database, email, social media and display advertising campaigns
b)Design, build and maintain our social media presence
c)Collaborate with internal teams to create landing pages and optimize user experience
d)Utilize strong analytical ability to evaluate end-to-end customer experience across multiple channels and c
Responsibilities and Duties

  • Reviewing and analyzing client sites for areas that can be improved and optimized
  • Preparing detailed strategy reports
  • Identifying powerful keywords to drive the most valuable traffic
  • Running PPC campaigns
  • Writing powerful calls-to-action to convert visitors
  • Email Marketing , Social Media Marketing, Content writing
  • Filling websites and other content with effective keywords
  • Writing effective SEO content for blogs, websites and social media accounts
  • Developing link building strategies>
  • Analysing keywords and SEO techniques used by competitors
  • Keeping updated on both white hat and black hat SEO strategies to avoid stay within search engine guidelines
  • Compiling and presenting SEO guidelines

    Qualifications and Skills
    Demonstrable experience leading and managing SEO/SEM, marketing database, email, social media and/or display advertising campaigns
    Highly creative with experience in identifying target audiences and devising digital campaigns that engage, inform and motivate
    Solid knowledge of website analytics tools (e.g., Google Analytics, NetInsight, Omniture, WebTrends)
    Experience in setting up and optimizing Google Adwords campaigns
    Working knowledge of HTML, CSS, and JavaScript development and constraints
    Strong analytical skills and data-driven thinking
    Up-to-date with the latest trends and best practices in online marketing and measurement

    • Prior experience in content marketing, content growth and SEO
    • Working knowledge of search engine optimization practices
    • Outstanding ability to think creatively, strategically , and identify and resolve problems
    • Excellent verbal and written communication skill
    • Ability to work within a team and independently
    • Familiarization Google analytics
    • Experience with website optimization tools
    • Strong organizational, time management, and analytical skills
    • Should be independently able to create & handle all social media activities like Linkedin, FB, Twitter, Instgram etc.
    • Should be able to create content for posts, write blogs on our services & be able to write case studies & white papers.
Read more
Griffon Technology
at Griffon Technology
2 recruiters
Honey Jain
Posted by Honey Jain
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
1 - 7 yrs
₹10L - ₹15L / yr
skill icon.NET
ASP.NET
skill iconAngularJS (1.x)
skill iconAngular (2+)
skill iconJavascript
+12 more
  • frames and using Agile methodology.
  • Basic Azure server administration - Provide technical help during testing, development, and production.
  • Discover, evaluate, and implement new technologies to maximize development efficiency - Design and implement complex, optimized algorithms with minimum time and space complexities

Requirements.

  • Experience in .Net web development - Experience with C#, Angular Js, Angular2, SQL.
  • Sound understanding of MVC design Pattern 
  • Strong knowledge/understanding of OOPS concepts
  • Experience with tools like Visual Studio, SQL Server, Git
  • Good analytical and logical skills.
  • Good written and verbal communication skills
  • Passion for new technologies and innovations.
  • Ability to grasp new concepts quickly.
  • Takes initiative to uncover/develop solutions to potential problems
  •  Ability to take on new projects and easily transition between tasks
  • Team player who is receptive to coaching and adaptive to change
  • Desire to excel and grow each day
  • Strong knowledge of Web APIs, Typescript, ES6, ngrx

Nice to Have 

    • Experience with of LESS, SASS, GULP and GRUNT. 
  • Knowledge of VueJS
  • .Net Framework and/or .Net Core
  • Angular 2+, preferable Angular 10
  • Experience with tools like Visual Studio, SQL Server, Git
  • Material framework
  • SASS
  • Good technical aptitude
  • Restful APIs
  • Data structures and Algorithms
  • Azure experience including Azure functions etc.
  • Azure Devops
Read more
Genius Placement Service
Muskan Keshvani
Posted by Muskan Keshvani
Ahmedabad
1 - 5 yrs
₹2L - ₹6L / yr
skill iconAndroid Development
skill iconXML
skill iconKotlin
skill iconJava
MySQL
Android Developer

Experience: 3-5 Years 1 candidate & 1-3 Years 2 candidate

Skills:      

Core JAVA(Native), Core Kotlin, Sqlite, MySQL, XML

 

Read more
Testbook
at Testbook
8 recruiters
Aman Raj
Posted by Aman Raj
Delhi, Pune, Lucknow, Allahabad, Patna, Jaipur
3 - 5 yrs
₹4L - ₹5L / yr
Event Management
Lead Generation
Below The Line Marketing (BTL)

Job Description:

● Event Manager will ensure Manager availability to the sales team. He will be responsible for

enquiry generation and nurturing enquiries into leads.

● Event Manager will plan the calendar along with City head and central leadership and get sign-off

on budgets.

● Tie-ups with colleges to conduct seminars and workshops

● Conduct seminars/workshops along with City head for govt exams and skills

● Canopy and counseling activities in colleges to generate enquiry

● Flyer distribution and enquiry generation outside coaching centers, colleges and parks (local

high-student density areas)

● Source leads across city from various sources such as library/ book stores/ cyber cafes/

photocopiers.

● Create hooks for partnerships in lead sharing and conversion

● Local events for inquiry generation across high-student density areas

● New center launch and regular center activation for generating desired spikes in inquiries.

● Arrange common student workshops/ seminars for Managernurturing.

● Create hooks for ensuring students visit centers for improved conversion

 

Eligibility Criteria:

● Should have extensive experience in school/ college partnerships, conducting seminars and

small-scale events, Managergeneration activities

● Should have 5+ years of experience in the EdTech industry

● Should have led 5+ member teams in lead generation activities in other EdTech companies

● Should be presentable to do college tie-ups and carry the Testbook brand

● Must have prior experience as he/she will be running as soon as he/she is onboarded

 

What is the culture like:

● Team of 8 marketing executives (all juniors)

● Should be ok to work odd hours and put in 100% effort

Read more
Hiring for a leading client
Hiring for a leading client
Agency job
via Jobaajcom by Saksham Agarwal
Remote only
6 - 10 yrs
₹10L - ₹20L / yr
skill iconNodeJS (Node.js)
skill iconExpress
MySQL
skill iconPostgreSQL
skill iconElastic Search
+2 more
Job Description:

● Should have 6+ years of experience as a software developer
● Good experience with Nodejs & Express js.
● Good with MySQL
● Experience with Linux Scripting
● Experience with elastic search and Logstash
● Experience with cyber security
● Great interpersonal and communication skills candidate can work         independently
● Agile project methodology experience preferred.
● Excellent communication skills.
● Critical thinker and good problem-solver.
● Good time-management skills
● Great interpersonal skills

Working Timings: 3:00 pm to 12:00 am (midnight)IST
Read more
Our client is  AI driven digital Manufacturing solution
Our client is AI driven digital Manufacturing solution
Agency job
via HyrEzy Talent Solutions by Ravi Prakash dubey
NCR (Delhi | Gurgaon | Noida)
1 - 3 yrs
₹4L - ₹8L / yr
skill iconPython
skill iconDjango
RESTful APIs
Python(django) | Backend Developer

Job description
● You'll design and build scalable systems using AI, ML to improve productivity in manufacturing operations
● You'll work on building web apps that are intuitive, intelligent and highly performant
● You will work with Designers, Solution Architect and Functional Consultant to define architecture and build
solutions
● You should be able to work in unstructured situations and help structure problems through discussions,
solutioning. Taking initiative, listening to others and working collaboratively on technology, product and
business would be really important
● You will work directly with founders from IIM, XLRI, DCE


Required Candidate profile

● Have 2-6 years of experience
● Come up with your own goals and don't need heavy direction or daily check-ins
● Have command and confidence on Python Django. Should be able to build complex solutions
● Have an understanding of databases - Relational and Non-Relational - their data models and
performance tradeoffs
● Have experience of database design and querying with a focus on performance
● Have knowledge of REST paradigm, service-oriented architecture and distributed systems
● Have a clear understanding of data structures and algorithms
Read more
spacejoy
at spacejoy
1 recruiter
Ritika gupta
Posted by Ritika gupta
Bengaluru (Bangalore)
3 - 8 yrs
₹20L - ₹50L / yr
Software Development
skill iconJavascript
skill iconNodeJS (Node.js)
skill iconGo Programming (Golang)
SQL
+1 more
Responsibilities:
● Work together with the team to prototype new solutions within emerging technologies
● Work with DevOps to build and scale tools and libraries to improve developer and user
experience
● Create backend services to ensure the best possible performance, quality, and
responsiveness of the applications
● Integration of user-facing elements developed by front-end developers with server-side logic
● Collaborate with team members to provide and receive architecture-level and code-level
feedback
Essential Qualifications:
● 5 + years of software development experience
● Bachelor’s Degree in Computer Science / Software Engineering.
● High sense of ownership, the zeal to build scalable and customer-focused applications.
● Strong knowledge of Javascript, Node js, and related frameworks (e.g. Express, Socket io)
● In-depth experience in SQL / NoSQL database design
● Experience in RESTful API design

● Understanding of fundamental design principles behind a scalable application
● Familiarity with the principles of agile and lean development methodologies
● TDD (unit, integration, and end to end)
● Experience working with deployment and orchestration technologies (such as Docker,
Kubernetes, Chef, Salt, Ansible, Jenkins, GIT, Vagrant)
● Knowledge of Web Server technologies- like IIS, Apache or Nginx
Read more
Tech Alpha Studios PVT LTD
Mukul Sharma
Posted by Mukul Sharma
Chandigarh
1 - 3 yrs
₹3L - ₹6L / yr
skill iconReact.js
skill iconJavascript
skill iconRuby on Rails (ROR)
skill iconNodeJS (Node.js)
skill iconMongoDB
+2 more

We're looking for a Full Stack developer who will take a key role on our team. Our Full Stack developer must have knowledge in all stages of software development.

 

Requirements:

  • Design overall architecture of the web application.
  • Maintain quality and ensure responsiveness of applications.
  • Collaborate with the rest of the engineering team to design and launch new features.
  • Maintain code integrity and organisation.
  • Experience working with graphic designers and converting designs to visual elements.
  • Understanding and implementation of security and data protection.
  • Highly experienced with back-end programming with NodeJS, you can easily design and integrate the REST APIs with front end.
  • Well versed with JavaScript (frameworks such as ReactJS).
  • Development experience for both mobile and desktop.
  • Experience with cloud message APIs and usage of push notifications.
  • Knowledge of code versioning tools such as Git.
  • Knowledge about Firebase & GoLang is an added advantage.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos