Cutshort logo
Propellor.ai logo
Big Data Engineer
Big Data Engineer
Propellor.ai's logo

Big Data Engineer

Kajal Jain's profile picture
Posted by Kajal Jain
1 - 4 yrs
₹5L - ₹15L / yr
Remote only
Skills
skill iconPython
SQL
Spark
Hadoop
Big Data
Data engineering
PySpark

Big Data Engineer/Data Engineer


What we are solving
Welcome to today’s business data world where:
• Unification of all customer data into one platform is a challenge

• Extraction is expensive
• Business users do not have the time/skill to write queries
• High dependency on tech team for written queries

These facts may look scary but there are solutions with real-time self-serve analytics:
• Fully automated data integration from any kind of a data source into a universal schema
• Analytics database that streamlines data indexing, query and analysis into a single platform.
• Start generating value from Day 1 through deep dives, root cause analysis and micro segmentation

At Propellor.ai, this is what we do.
• We help our clients reduce effort and increase effectiveness quickly
• By clearly defining the scope of Projects
• Using Dependable, scalable, future proof technology solution like Big Data Solutions and Cloud Platforms
• Engaging with Data Scientists and Data Engineers to provide End to End Solutions leading to industrialisation of Data Science Model Development and Deployment

What we have achieved so far
Since we started in 2016,
• We have worked across 9 countries with 25+ global brands and 75+ projects
• We have 50+ clients, 100+ Data Sources and 20TB+ data processed daily

Work culture at Propellor.ai
We are a small, remote team that believes in
• Working with a few, but only with highest quality team members who want to become the very best in their fields.
• With each member's belief and faith in what we are solving, we collectively see the Big Picture
• No hierarchy leads us to believe in reaching the decision maker without any hesitation so that our actions can have fruitful and aligned outcomes.
• Each one is a CEO of their domain.So, the criteria while making a choice is so our employees and clients can succeed together!

To read more about us click here:
https://bit.ly/3idXzs0" target="_blank">https://bit.ly/3idXzs0

About the role
We are building an exceptional team of Data engineers who are passionate developers and wants to push the boundaries to solve complex business problems using the latest tech stack. As a Big Data Engineer, you will work with various Technology and Business teams to deliver our Data Engineering offerings to our clients across the globe.

Role Description

• The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analysing, and visualizing large sets of data to turn information into business insights
• Develop the software and systems needed for end-to-end execution on large projects
• Work across all phases of SDLC, and use Software Engineering principles to build scalable solutions
• Build the knowledge base required to deliver increasingly complex technology projects
• The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction.

Education & Experience
• B.Tech. or Equivalent degree in CS/CE/IT/ECE/EEE 3+ years of experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.

Must have (hands-on) experience
• Python and SQL expertise
• Distributed computing frameworks (Hadoop Ecosystem & Spark components)
• Must be proficient in any Cloud computing platforms (AWS/Azure/GCP)  • Experience in in any cloud platform would be preferred - GCP (Big Query/Bigtable, Pub sub, Data Flow, App engine )/ AWS/ Azure

• Linux environment, SQL and Shell scripting Desirable
• Statistical or machine learning DSL like R
• Distributed and low latency (streaming) application architecture
• Row store distributed DBMSs such as Cassandra, CouchDB, MongoDB, etc
. • Familiarity with API design

Hiring Process:
1. One phone screening round to gauge your interest and knowledge of fundamentals
2. An assignment to test your skills and ability to come up with solutions in a certain time
3. Interview 1 with our Data Engineer lead
4. Final Interview with our Data Engineer Lead and the Business Teams

Preferred Immediate Joiners

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Propellor.ai

Founded :
2016
Type :
Products & Services
Size :
20-100
Stage :
Raised funding

About


Who we are


At Propellor, we are passionate about solving Data Unification challenges faced by our clients. We build solutions using the latest tech stack. We believe all solutions lie in the congruence of Business, Technology, and Data Science. Combining the 3, our team of young Data professionals solves some real-world problems. Here's what we live by:


Skin in the game

We believe that Individual and Collective success orientations both propel us ahead.

 

Cross Fertility

Borrowing from and building on one another’s varied perspectives means we are always viewing business problems with a fresh lens.

 

Sub 25's

A bunch of young turks, who keep our explorer mindset alive and kicking.

 

Future-proofing

Keeping an eye ahead, we are upskilling constantly, staying relevant at any given point in time.

 

Tech Agile

Tech changes quickly. Whatever your stack, we adapt speedily and easily.


If you are evaluating us to be your next employer, we urge you to read more about our team and culture here: https://bit.ly/3ExSNA2. We assure you, it's worth a read!

Read more

Tech stack

skill iconPython
Apache Spark
Hadoop
skill iconMachine Learning (ML)

Company video

Propellor.ai's video section
Propellor.ai's video section

Candid answers by the company

What is Propellor.ai?
How do you define the company’s culture?
Two things techies love about the company?
What is the compensation philosophy?
Why join Propellor.ai?
Video thumbnail
Video thumbnail

Photos

Company featured pictures
Company featured pictures
Company featured pictures
Company featured pictures
Company featured pictures

Connect with the team

Profile picture
Anila Nair
Profile picture
abhijat shukla
Profile picture
Kajal Jain

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Bengaluru (Bangalore)
7 - 10 yrs
$3.5K - $5K / yr
skill icon.NET
skill iconReact.js
Microsoft Windows Azure
Software architecture
Domain-driven design
+2 more

Requirements:


  • 7+ years in enterprise application development
  • Proven track record of delivering complex digital solutions
  • Advanced knowledge of React hooks, context API, and component and global state management
  • Experience with atomic design, component libraries, and TypeScript
  • Proficiency in React performance optimization and modern features
  • Strong experience with modern .NET (6+)
  • Proven track record applying Clean Architecture & Clean Code & SOLID principles & DDD patterns
  • Expertise in building scalable REST APIs and microservices
  • Experience with Azure Service Bus, Event Grid, and message-based architectures
  • Proficiency in resources like App Insights, Function Apps, Key Vaults, and App Services
  • Expertise in cloud development and deployment strategies
  • Strong understanding of business needs, ability to meet them by creating cutting-edge solutions
  • Brilliant communication abilities, knowing how to explain technical details and processes to a non-tech person
  • Fluency in English


Nice to have:


  • Test automation (Playwright/Cypress)
  • Building CI/CD pipelines in Azure DevOps
  • API-first development and OpenAPI specifications
  • Experience with agile at scale (SAFe/Spotify)
  • Proficiency with AI-powered development tools (GitHub Copilot, Cursor, etc.) to enhance productivity
  • Bachelor's or Master's degree in Computer Science or a related field

 

 Responsibilities:

 

  • Front-end, API, and back-end development, ensuring the successful delivery of digital solutions
  • Drive innovation by staying informed about emerging technologies, industry trends, and best practices
  • Collaborate with the Product Manager, UX/UI Designers, and Engineering Manager to define agile technical requirements, provide technical estimation, and prioritize backlogs based on business needs and technical feasibility
  • Participate in sprint planning, backlog grooming, and release planning meetings to ensure alignment between technical implementation and product roadmap
  • Participate in hands-on development activities, including coding, debugging, and troubleshooting, to deliver high-quality applications
  • Design, architecture, development of digital applications, ensuring adherence to best practices, coding standards, and architectural principles
  • Design scalable architectures for multi-region deployment
  • Implement test automation strategies and frameworks to automate testing processes and ensure the quality and reliability of applications
  • Automate test cases and integrate testing into the CI/CD pipeline
  • Conduct code reviews to ensure adherence to coding standards, best practices, and architectural guidelines
  • Define and implement code best practices, development standards, and documentation processes to maintain code quality and readability
  • Integrate digital applications with existing digital assets, backend systems, and third-party APIs, ensuring seamless data exchange and interoperability
  • Collaborate with integration teams to design and implement integration solutions that meet business requirements and architectural standards
  • Communicate technical concepts and solutions to non-technical stakeholders in a clear and understandable manner


Read more
JFrog
at JFrog
8 recruiters
Shalini Jakhar
Posted by Shalini Jakhar
Bengaluru (Bangalore)
6 - 14 yrs
₹30L - ₹45L / yr
skill iconGo Programming (Golang)
skill iconKubernetes

At JFrog, we’re reinventing DevOps to help the world’s greatest companies innovate -- and we want you along for the ride. This is a special place with a unique combination of brilliance, spirit and just all-around great people. Here, if you’re willing to do more, your career can take off. And since software plays a central role in everyone’s lives, you’ll be part of an important mission. Thousands of customers, including the majority of the Fortune 100, trust JFrog to manage, accelerate, and secure their software delivery from code to production -- a concept we call “liquid software.” Wouldn't it be amazing if you could join us in our journey?


We are looking for an experienced, hands-on senior developer to join an innovative and talented Product & Engineering team, responsible for delivering fast and high quality code, using the latest frameworks and technologies.


As a Senior Golang Developer in JFrog you will... 

  • Be responsible for all development aspects form design to production of a wide hybrid/ cloud native product 
  • Write high quality, testable and efficient code in Go
  • Initiate and promote new ideas for continuous improvement of the product functionality
  • Work closely with other team members as well as mentoring new team members

To be a Senior Golang Developer in JFrog you need...

  • 6+ years of industry experience
  • Proven deep knowledge of GoLang.
  • Deep understanding of concurrent programming and performance tuning
  • Vast experience with large scale production environments 
  • Experience with micro services architecture
  • Familiarity with Cloud infrastructure, Docker, Kubernetes & CI/CD
  • Disciplined approach to testing and quality assurance

NOTE: This is a hybrid role (3 days per week mandatory work from office). We are located in Bellandur, Bangalore.

Read more
Sequoiaat India Private Limited
Preeyanka Moses
Posted by Preeyanka Moses
Chennai, Trivandrum, Kochi (Cochin), Ernakulam, Kerala, Kanyakumari
2 - 7 yrs
₹4L - ₹8L / yr
skill iconNodeJS (Node.js)
skill iconExpress
skill iconJavascript
About Team Sequoia
 Our team believes if we are passionate about what we do we can produce amazing quality and offer outstanding customer service. From large corporation to startups our solutions go into many products used by you in daily life. We pride ourselves on being able to associate with our clients to develop custom software solutions.

An Engineer’s Life @ SequoiaAT

As an Engineer, SequoiaAT will be a dream job for you. You will have an opportunity to work on technologies and product before they hit the market and get popular. If working on a gadget you may get to own one of them as an early tester. Working with us we have a be your own boss culture so you will have plenty of opportunities to interact directly with our customers and their customer. Our goals just do not end there, we want to work with you on your personal development goals and ensure that you meet them. We work on projects involving hardware integration, Wireless Including (BLE, LoRa, WiFi etc.) , Data Analytics, Digital Transformation etc. We are all engineers and we do not want you to have a feeling that you got stuck on one project and could not grow your career. We expect you to contribute to a variety of projects during a given period of time. We keep you well informed about new technology trends through our tech chat sessions and secondary skill development process.

Is it right job the right one for you?

If you are passionate and through about what you have been doing and willing to learn daily, then you will fit in very well. You should also have the ability to freely and clearly communicate your ideas or thoughts to succeed at SequoiaAT.

What Technology Skills required for this?

Primary Skills: Node.js What’s expected from your experience in primary skills area?
Strong proficiency in Node.js, frameworks (e.g. Express), and JavaScript Development of server-side logic, including APIs and views.
Deep knowledge of server-side templating languages, front-end technologies, fundamental design principles, HTML5, and CSS.
Integration of third party APIs Deployment of autoscaling strategies Write reusable, testable, and efficient code.
Proficient understanding of code versioning tools such as Git Understanding of the Agile Development Process (i.e. Scrum)
Knowledge in React is a plus Secondary Skills

 
Read more
Snappymob
at Snappymob
3 recruiters
Nirbhay Shah
Posted by Nirbhay Shah
Remote, Kuala Lumpur
3 - 15 yrs
₹10L - ₹21L / yr
skill iconPHP
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+6 more



Job Description : Senior Full Stack Developer


Role


A Full Developer at Snappymob is an integral member of the software engineering team that designs and develops world-class applications that are relied on by our customers to be highly reliable and performant.


You'll be working closely with other engineers in the team to work on delightful applications and features that make a big impact on users. We're looking for people who share our passion for writing great software and our love for making use of best practices in our software development process.


Responsibilities


  • Architect, design, develop, and maintain web based applications and services with a focus on Node.js-based backend development.
  • Design and implement high quality RESTful APIs.
  • Collaborate with the engineering team at large in software design sessions, code reviews, teaching, and other engineering activities.
  • Collaborate with other team members including the mobile development team and design team.
  • Participate in all aspects of the software development lifecycle for our projects.


Requirements


  • 3 or more years of a mix of frontend and backend development experience.
  • Ability to think critically, analyze, and break down problems into manageable components.
  • Strong attention to detail.
  • Ability to communicate and work well with others.


Backend Skills


  • Strong knowledge and experience with developing RESTful APIs.
  • Strong knowledge and experience with one or more backend development stacks: Spring Boot, NodeJS + Express, Rails, or similar.
  • Strong knowledge and experience with one or more of PostgreSQL, MySQL or other relational databases.
  • Knowledge and experience with one or more cloud infrastructure providers: AWS, GCP, Azure.
  • Strong knowledge and experience of integration of third party services.
  • Experience utilizing various third party backend frameworks and libraries.


Frontend Skills


  • Strong knowledge and experience with frontend fundamentals: HTML, CSS, JS.
  • Strong knowledge and experience with one or more web oriented development languages: JS, TypeScript, PHP, Ruby, or other.
  • Strong knowledge and experience in at least one frontend framework: Vue.js, React, Angular, or other.
  • Experience utilizing various third party frameworks and libraries.


Good-to-have Experiences: 


  • E-commerce platforms: Magento, WooCommerce, etc.
  • Content management systems: Drupal, Wordpress.
  • Self-hosting cloud services: NextCloud, Gitlab, Gitea; or other SysAdmin-related tools: Wireguard.
  • Containerization and orchestration solutions: Docker and Kubernetes.


As one of Malaysia's top app development companies, Snappymob helps top brands in Malaysia and around the world turn their ideas into reality by creating impactful digital products. Our clients span from startups to multinationals across many industries including finance, media, healthcare, energy, and education.

By pairing awesome user experience design and solid software engineering, we strive to help our clients achieve success – while providing them honest, no-nonsense advice.


Visit us at snappymob.com to find out more about what we do.



Read more
Genius Placement Service
at Genius Placement Service
2 recruiters
Anjani Patel
Posted by Anjani Patel
Ahmedabad
1 - 1 yrs
₹1L - ₹2L / yr
Communication Skills
Lead Generation
Sales
Telesales

POST: Tele callers (Females Only)

 

JD Includes:

 

  • Relevant Experience from Loan/Insurance Industry
  • Excellent Communication
  • Hardworking with Sales Orientation
  • Ability to drive Targets
Read more
A fast-growing SaaS commerce company permanent WFH & Office
A fast-growing SaaS commerce company permanent WFH & Office
Agency job
via Jobdost by Mamatha A
Remote, Bengaluru (Bangalore)
5 - 10 yrs
₹25L - ₹45L / yr
Software Testing (QA)
Test Automation (QA)
Appium
Selenium
skill iconJava
+2 more

What is the role?

This position will play a primary role in planning, implementing, leading, and executing all aspects of Quality and Testing. The role requires hands-on QA expertise, ability to take initiative, develop, and evolve our QA processes. The right candidate will be able to analyze the systems to determine what to test, the priority of those tests and the best way to test.

Key Responsibilities

  • Perform impact/test analysis for the new features, feature-enhancements, and bug fixes.
  • Conduct test design and test execution for functional/non-functional aspects of features / product.
  • Hands-on execution for functional/non-functional aspects of features / product.
  • Automate the tests to ensure repeatability of tests.

What are we looking for?

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of it. We are open to promising candidates who are passionate about their work and are team players.

  • 1 to 4 year's experienced software quality professional.
  • Experienced developing and executing test cases, scripts, plans and procedures to support various development methodologies.
  • Familiarity with entire software development life cycle and test cycles (Unit, Regression, Functional, Systems, Performance and Volume, User Acceptance).
  • Knowledge & experience on java or python, selenium, Appium, etc. to perform the automation of websites and apps on desktop/handheld devices.
  • Knowledge & experience on tools like JMeter, Gatling, locust to perform non-functional tests.
  • Detailed and effective written communication skills for documenting the features tested and bugs found.
  • Highly organized, detail oriented, extremely responsive candidate who would like to take up technical challenges.
  • Self-motivated, works well independently and with others.

Whom will you work with?

You will work with a top-notch tech team and report to the engineering head.

What can you look for?

A wholesome opportunity in a fast-paced environment will enable you to juggle between concepts yet maintain the quality of content, interact, share your ideas, and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits

We are

A fast-growing SaaS commerce company based in Bangalore with offices in Delhi, Mumbai, SF, Dubai, Singapore, and Dublin. We have three products in our portfolio: Plum, Empuls, and Compass. Works with over 1000 global clients. We help our clients engage and motivate their employees, sales teams, channel partners, or consumers for better business results.

Read more
httpscarestackcom
at httpscarestackcom
1 recruiter
Biby Mathew
Posted by Biby Mathew
Bengaluru (Bangalore), trivandrum, Thiruvananthapuram, Cochin
10 - 15 yrs
₹15L - ₹35L / yr
Architecture
Data architecture
Data Architect
Microsoft SQL Server
Performance Testing
+5 more
Responsibilities
• Lead the Development Team.
• Strong in SQL Coding and performance tuning.
• Strong in Data warehousing concepts and design.
• Strong in ETL process and implementation.
• Participate in database design and architecture to support application development
activities.
• Experience in writing and reviewing complex functions, stored procedures, and custom
scripts to support application development.
• Tuning application queries by analysing execution plans.
• Experience in data migration between different DB systems.
• Expertise in trouble shooting day to day production issues in DB.
• Oversee progress of development team to ensure consistency with initial design
Skills and Qualifications
• 8+ years of professional experience with at least 2 years as an architect.
• Deep knowledge in SQL Server is a must. Knowledge in MySQL and Vertica would be an
asset.
• Ability to work in a very dynamic environment & ready to support production
environment.
• Organised, self-motivated, team player, actions and result oriented.
• Ability to successfully work under tight timelines.
• Good verbal and written communication skills.
• Ability to meet production targets and milestones.
Read more
CoinSwitch
at CoinSwitch
3 recruiters
Agency job
via HuntnBadge by Lokesh Waran
Remote, Bengaluru (Bangalore)
1 - 9 yrs
₹22L - ₹55L / yr
skill iconJava
J2EE
Struts
Spring
Hibernate (Java)
+4 more

Responsibilities

  • You will design and develop large scale distributed services
  • You will analyse and improve the efficiency, scalability, stability, and security of the platform as a whole.
  • You will act as the primary owner of one or more components while driving innovation in your area of ownership
  • You will proactively research & evaluate new tools, technologies, and techniques to improve the value of the system.
  • You will work with engineering leadership in solving and architecting solutions for challenging or complex development issues.
  • You will work independently and handle dependencies with very minimal oversight
  • You will take initiatives in developing and maintaining integrations of best practices within the back-end.
  • You will help identify systemic issues, performance bottlenecks and work on design/architect improvements.

Requirements

  • You have 1 - 9 years of experience in software development.
  • You have designed and scaled up the system.
  • You have a strong understanding of Data Structures and Algorithms.
  • You are an incessant problem solver and tougher the problem gets, more fun you have.
  • You have strong command in any one or more of the following languages: Python and Django
  • You understand the business impact of your decisions.

Good To Have

  • You have prior experience in fintech companies

Traits We Are Looking For

  • Experience in a specific tech stack doesn't matter for us.
  • The general engineering mindset and aptitude is what matters more.
  • Technically strong and curious.
  • Should have a hacker mindset and should love exploring new technologies.

 

Desired Skills and Experience

Java, Python, Data Structures, Algorithms

 

 

 

Read more
Lymbyc
at Lymbyc
1 video
2 recruiters
Venky Thiriveedhi
Posted by Venky Thiriveedhi
Bengaluru (Bangalore), Chennai
4 - 8 yrs
₹9L - ₹14L / yr
Apache Spark
Apache Kafka
Druid Database
Big Data
Apache Sqoop
+5 more
Key skill set : Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architectures Responsibilities : - Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics - Design and implement data aggregation, cleansing and transformation layers Skills : - Around 4+ years of hands-on experience designing and operating large data platforms - Experience in Big data Ingestion, Transformation and stream/batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc; - Experience in designing and building streaming data platforms in Lambda, Kappa architectures - Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc; - Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse - Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto - Experience in designing and consuming microservices - Exposure to security and governance tools like Apache Ranger, Apache Atlas - Any contributions to open source projects a plus - Experience in performance benchmarks will be a plus
Read more
Altius Customer Services Pvt Ltd
at Altius Customer Services Pvt Ltd
1 video
1 recruiter
Yasmin Khan
Posted by Yasmin Khan
Nagpur
1 - 2 yrs
₹1L - ₹2L / yr
skill iconSwift
skill iconiOS App Development
skill iconObjective C
Xcode
Cocoa Touch
  • Candidate should be expertise in iOS technology.
  • Experience with developing native Applications using Swift 3 , Xcode, Objective C, Cocoa and iPhone SDK.
  • Built and published commercial iPhone and iPad applications
  • Candidate must have independently designed and developed mobile applications
  • independently drive the design and development of iPhone/iPad application project.
    Conceptualize and design Mobile applications based on need.
  • Experience with Objective-C, JavaScript, and JSON
  • Coursework in Object-Oriented programming languages (C++/Java, etc)
  • Understanding of Apple’s design principles and interface guidelines Animation, etc.
  • Candidate can develop Mobile Apps and well-versed with the Android SDK.
  • Have a good knowledge of Java Application development.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos