Cutshort logo
Propellor.ai logo
Big Data Engineer
Big Data Engineer
Propellor.ai's logo

Big Data Engineer

Kajal Jain's profile picture
Posted by Kajal Jain
1 - 4 yrs
₹5L - ₹15L / yr
Remote only
Skills
skill iconPython
SQL
PySpark
Data engineering
Big Data
Hadoop
Spark

Big Data Engineer/Data Engineer


What we are solving
Welcome to today’s business data world where:
• Unification of all customer data into one platform is a challenge

• Extraction is expensive
• Business users do not have the time/skill to write queries
• High dependency on tech team for written queries

These facts may look scary but there are solutions with real-time self-serve analytics:
• Fully automated data integration from any kind of a data source into a universal schema
• Analytics database that streamlines data indexing, query and analysis into a single platform.
• Start generating value from Day 1 through deep dives, root cause analysis and micro segmentation

At Propellor.ai, this is what we do.
• We help our clients reduce effort and increase effectiveness quickly
• By clearly defining the scope of Projects
• Using Dependable, scalable, future proof technology solution like Big Data Solutions and Cloud Platforms
• Engaging with Data Scientists and Data Engineers to provide End to End Solutions leading to industrialisation of Data Science Model Development and Deployment

What we have achieved so far
Since we started in 2016,
• We have worked across 9 countries with 25+ global brands and 75+ projects
• We have 50+ clients, 100+ Data Sources and 20TB+ data processed daily

Work culture at Propellor.ai
We are a small, remote team that believes in
• Working with a few, but only with highest quality team members who want to become the very best in their fields.
• With each member's belief and faith in what we are solving, we collectively see the Big Picture
• No hierarchy leads us to believe in reaching the decision maker without any hesitation so that our actions can have fruitful and aligned outcomes.
• Each one is a CEO of their domain.So, the criteria while making a choice is so our employees and clients can succeed together!

To read more about us click here:
https://bit.ly/3idXzs0" target="_blank">https://bit.ly/3idXzs0

About the role
We are building an exceptional team of Data engineers who are passionate developers and wants to push the boundaries to solve complex business problems using the latest tech stack. As a Big Data Engineer, you will work with various Technology and Business teams to deliver our Data Engineering offerings to our clients across the globe.

Role Description

• The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analysing, and visualizing large sets of data to turn information into business insights
• Develop the software and systems needed for end-to-end execution on large projects
• Work across all phases of SDLC, and use Software Engineering principles to build scalable solutions
• Build the knowledge base required to deliver increasingly complex technology projects
• The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction.

Education & Experience
• B.Tech. or Equivalent degree in CS/CE/IT/ECE/EEE 3+ years of experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.

Must have (hands-on) experience
• Python and SQL expertise
• Distributed computing frameworks (Hadoop Ecosystem & Spark components)
• Must be proficient in any Cloud computing platforms (AWS/Azure/GCP)  • Experience in in any cloud platform would be preferred - GCP (Big Query/Bigtable, Pub sub, Data Flow, App engine )/ AWS/ Azure

• Linux environment, SQL and Shell scripting Desirable
• Statistical or machine learning DSL like R
• Distributed and low latency (streaming) application architecture
• Row store distributed DBMSs such as Cassandra, CouchDB, MongoDB, etc
. • Familiarity with API design

Hiring Process:
1. One phone screening round to gauge your interest and knowledge of fundamentals
2. An assignment to test your skills and ability to come up with solutions in a certain time
3. Interview 1 with our Data Engineer lead
4. Final Interview with our Data Engineer Lead and the Business Teams

Preferred Immediate Joiners

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Propellor.ai

Founded :
2016
Type :
Products & Services
Size :
20-100
Stage :
Raised funding

About


Who we are


At Propellor, we are passionate about solving Data Unification challenges faced by our clients. We build solutions using the latest tech stack. We believe all solutions lie in the congruence of Business, Technology, and Data Science. Combining the 3, our team of young Data professionals solves some real-world problems. Here's what we live by:


Skin in the game

We believe that Individual and Collective success orientations both propel us ahead.

 

Cross Fertility

Borrowing from and building on one another’s varied perspectives means we are always viewing business problems with a fresh lens.

 

Sub 25's

A bunch of young turks, who keep our explorer mindset alive and kicking.

 

Future-proofing

Keeping an eye ahead, we are upskilling constantly, staying relevant at any given point in time.

 

Tech Agile

Tech changes quickly. Whatever your stack, we adapt speedily and easily.


If you are evaluating us to be your next employer, we urge you to read more about our team and culture here: https://bit.ly/3ExSNA2. We assure you, it's worth a read!

Read more

Tech stack

skill iconPython
Apache Spark
Hadoop
skill iconMachine Learning (ML)

Company video

Propellor.ai's video section
Propellor.ai's video section

Candid answers by the company

What is Propellor.ai?
How do you define the company’s culture?
Two things techies love about the company?
What is the compensation philosophy?
Why join Propellor.ai?
Video thumbnail
Video thumbnail

Photos

Company featured pictures
Company featured pictures
Company featured pictures
Company featured pictures
Company featured pictures

Connect with the team

Profile picture
Anila Nair
Profile picture
abhijat shukla
Profile picture
Kajal Jain

Company social profiles

bloginstagramlinkedintwitterfacebook

Similar jobs

Cambay Healthcare LLC
Nashra Nisar
Posted by Nashra Nisar
Nashik
2 - 10 yrs
₹5L - ₹6L / yr
Communication Skills
IT consulting

We are looking for Technical Recruiters to manage our full-cycle recruitment, from identifying potential hires to interviewing and evaluating candidates.

Key Responsibilities:

  • Work closely with the Recruiting leads and hiring managers.
  • Procure people for different IT Requirements.
  • Use niche platforms related to IT, to source potential candidates.
  • Personally, conduct interviews, document the same, and report as the need arises.
  • In addition to executing individual responsibility should be able to work in unison with the other departments with the Company’s growth perspective in mind.
  • Keeping abreast of the industry trends.

Requirements:

  • Having 3 Years experience in a similar role in a similar industry
  • Must be comfortable working in US shifts.
  • Ability to display deep sourcing skills and excellent candidate assessment skills.
  • Should be self-motivated as well as a team player.
  • The ability to think analytically to consider all applicants and recommend the right fit for the organization.
  • Should have excellent communication skills.
  • Proficient in English.

Read more
Emids Technologies
at Emids Technologies
2 candid answers
Darshan K
Posted by Darshan K
Bengaluru (Bangalore)
7 - 14 yrs
Best in industry
Information security
Implementation
Risk Management
Cyber Security
ISO 27001:2013
+7 more

Experience:- Overall 10 to 12 years of experience of which atleast 5 to 7 years’ experience should be in Information Security. Mandatory is 5 to 7 years’ experience in Information security and with one full end to end implementation experience.

Base location: - Bengaluru - Must

Requirements: -

  1. Mandatory - ISO 27001:2013 lead implementor certified
  2. Mandatory - ISO 27001:2013 lead auditor certified (but if it is a good candidate, we can still consider)
  3. Good to have – CISA, CISM, Risk management certification, Privacy certifications.
  4. Mandatory - Atleast one end to end implementation experience of ISO 27001 standard. The candidate should have a good implementation knowledge of ISO 27001, ISO 27002 standards and is required to implement the ISO requirements and run the ISMS program for multiple countries.
  5. This immediate requirement is for implementing the ISMS program for our Canadian office location. The candidate should be willing to work from Bengaluru in EST time zone during this implementation phase whenever required.
  6. Good documentation skills.
  7. Develop, implement, maintain, review and continually improve Information Security policies.
  8. Good understanding and knowledge of applicable legal and regulatory requirements as relevant to information security.
  9. Manage and maintain a risk register / risk database along with risk treatment plans.
  10. Good understanding of physical and environmental security.
  11. Conduct Internal Audits based ISO 27001 standards and Personal Data Protection policies. A good experience in independently conducting Internal and supplier audit with respect to information security.
  12. Provide training to the employees on Privacy & Information Security Management System on regular intervals.
  13. The greater part of the job involves interacting with people, interviewing them / auditing, Preparing audit reports, discussing / persuading / influencing.
  14. Mandatory: Good verbal and written communication skills. Eye for details.
  15. Good presentation skills.
  16. Since this is a trusted role, candidates must be willing to undergo extensive background checks to verify their identity, character, qualifications, skills and experience.
Read more
A fast-growing SaaS commerce company permanent WFH & Office
A fast-growing SaaS commerce company permanent WFH & Office
Agency job
via Jobdost by Mamatha A
Remote, Bengaluru (Bangalore)
6 - 9 yrs
₹25L - ₹40L / yr
skill iconAmazon Web Services (AWS)
Data Warehouse (DWH)
MySQL
NOSQL Databases
skill iconPostgreSQL
+4 more

Job Description :

A candidate who has a strong background in the design and implementation of scalable architecture and a good understanding of Algorithms, Data structures, and design patterns. Candidate must be ready to learn new tools, languages, and technologies

Skills :

Microservices, MySQL/Postgres, Kafka/Message Queues, Elasticsearch, Data pipelines, AWS Cloud, Clickhouse/Redshift

What you need to succeed in this role

  • Minimum 6 years of experience
  • Good understanding of various database types: RDBMS, NoSQL, GraphDB, etc
  • Ability to build highly stable reliable APIs and backend services.
  • Should be familiar with distributed, high availability database systems
  • Experience with queuing systems like Kafka
  • Hands-on in cloud infrastructure AWS/GCP/Azure
  • Highly plus if know one or more of the following: Confluent ksql, Kafka connect, Kafka streams
  • Hands-on experience with data warehouse/OLAP systems such as Redshift, click house and added plus. 
  • Good communication and interpersonal skills

Benefits of joining us

  • Ability to join a small and growing team, and work with some of the coolest people you've ever met
  • Opportunity to make an impact, and leave your mark on this organization.
  • Competitive compensation, with the ability to shape your own career trajectory
  • Go Extra Mile with Learning and Development

What can you look for?

A wholesome opportunity in a fast-paced environment that will enable you to juggle between concepts, yet maintain the quality on content, interact and share your ideas and have loads of learning while at work. Work with a team of highly talented young professionals and enjoy the benefits of being at Xoxoday.

We are

A fast-growing SaaS commerce company based in Bangalore with offices in Delhi, Mumbai, SF, Dubai, Singapore and Dublin. We have three products in our portfolio: Plum, Empuls and Compass. Works with over 1000 global clients. We help our clients in engaging and motivating their employees, sales teams, channel partners or consumers for better business results.

Read more
Amazon
Amazon
Agency job
via HiringEye by Rajeev Reddy
Bengaluru (Bangalore)
10 - 15 yrs
₹1L - ₹15L / yr
Engineering Management
skill iconJava
skill iconNodeJS (Node.js)
skill iconPython
skill iconAndroid Development
+1 more

Advertising at our client is a fast-growing multi-billion dollar business that spans across desktop, mobile and connected devices; encompasses ads on our clients portal and a vast network of hundreds of thousands of third party publishers; and extends across US, EU and an increasing number of international geographies.The Supply Quality organization in Bangalore has the charter to solve optimization problems for ad programs to ensure high-quality ad-impressions. We develop advanced algorithms and systems to optimize performance for our advertisers and publishers. We are focused on solving a wide variety of problems in computational advertising like traffic quality prediction (robot and fraud detection), Security forensics and research, Viewability prediction, Brand Safety and experimentation. Our team includes experts in the areas of distributed computing, machine learning, statistics, optimization, text mining, information theory and big data systems.

The Supply Quality infrastructure(SQI) team builds large-scale real-time transactional solutions, batch and stream processing systems, internet scale crawling solutions and storage infrastructure. We process bid requests in the orders of tens of billions per day with our real-time, batch and stream processing systems. To handle data at this scale, we use cutting-edge open source technologies like Hadoop, Spark, Redis etc.. We are not tied to one technology. Instead, we use what is best suited for the purpose. All of our systems tend to be loosely coupled, communicating using synchronous and asynchronous messaging, leading to a classic distributed processing architecture. All our systems need to also implement complex machine learning and optimization algorithms at scale. 

We are looking for a talented Engineering Manager to lead a new big-data engineering initiative within SQI. The team will own building highly available, efficient and low latency internet scale infrastructure including web-scale crawler, contextual processing and classification systems that will be used across multiple advertising use cases. As a leader of the team, you will be responsible to evolve the charter of the team, work with stakeholders to set goals and deliver them. To succeed, you need to demonstrate sound technical acumen, excellent project management skills, great communication skills, and hire, build, and develop your team. You will be responsible for fostering a culture of engineering excelllence towards delivering cutting-edge solutions that materially improve customer experience.


Primary responsibilities:

  • Provide technical expertise and leadership throughout product life cycles, influence software engineers best practices for your team and own operational metrics
  • Work with business leaders and product managers to define product requirements.
  • Prioritize, communicate, maintain, and execute roadmaps, project plans, and commitments
  • Work with engineers to define technical requirements and architect and execute best-in-class implementations in agile manner
  • Build and maintain world-class customer experience and operational excellence for your deliverables
  • Hire, manage, mentor and grow a high performance team of Software Engineers

 

 

Read more
A leading company for Banks and Public Transport Operators
A leading company for Banks and Public Transport Operators
Agency job
via Tridat Technologies Pvt. Ltd. by Aasiya Waghoo
Mumbai
3 - 8 yrs
₹4L - ₹10L / yr
skill iconJava
Spring MVC
skill iconSpring Boot
Hibernate (Java)
JDBC
+2 more

Hello,

Greetings for the day !!!

Tridat Technologies is hiring "Java Developer" for one of the client based out @ Mumbai !!!

Experience: 3+yrs

Role: Java Developer

Desired Candidate Profile:                                                                                                   

  - Engineering / MCA / Graduate             

  - Good communication skill.     

  - Immediate joining preferable, Max 15 days

 

Role Requirements – 

  • 3+ years of experience developing software as an engineer.
  • Experience with developing, debugging, and shipping software products on large code bases that span platforms and tools
  • Significant experience building and operating critical high-scale systems.
  • Good software engineering methodology: meaningful and deep-rooted opinions about testing and code quality, ability to make sound quality/speed trade-offs.
  • Good technical skills in Java, Spring MVC ,Spring Boot, Hibernate, JDBC, JSP, Bootstrap, Relational Database, JMS, Active MQ
  • Lead from the front when the situation calls for it.

 Skills:

  • Significant experience building and operating critical high-scale systems.
  • Architecture: Knowledge of data structures and an eye for architecture. Can discuss the tradeoff between architectural choices, both on a theoretical level and on an applied level.
  • Strong coding/debugging abilities: Should have advanced knowledge of Java , Spring MVC ,Spring Boot, Hibernate, JDBC, JSP, Bootstrap, Relational Database, JMS, Active MQ
  • Fast learner: Thrive on learning new technologies. Should be able to adapt easily to meet the needs of our massive growth and rapidly evolving business environment.
  • Understands requirements beyond the written word: Whether working on an API used by other developers, an internal tool consumed by our operation teams, or a feature used by millions of customers, attention to details is important.

Employment Mode: COntract to hire 

Location: Mumbai (Pan India candidates will do)

Joining Period: Immediate to 15 days
Read more
A product based startup
A product based startup
Agency job
via Qrata by Mrunal Kokate
Mumbai
2 - 5 yrs
₹7L - ₹12L / yr
Test Automation (QA)
Software Testing (QA)
Test Planning
Organizational Overview
Qrata is currently searching for a full stack developer for a YC backed product startup. 
 
What does the company we are searching for do?
The company began life in February 2019 as an influencer marketplace that allowed influencers (especially nano and micro level influencers) partner with different brands. Its focus was to convert consumers into brand marketers and build strong word of mouth advocacy at scale. The team shifted base from Kolkata to Mumbai in September 2019 for better partnerships. Last month, the startup pivoted to the current format to build more stable revenue streams for the influencers and creators. The team believes that there is a bigger untapped opportunity in India for the same, considering the craze around celebrities/influencers in India. Each influencer or celebrity is listed on their platform, with rates specified by them. The user can click on their favorite celebrity and make a payment. S/he receives a shoutout within the next seven days. 
 
The Growth Metrics 
They started as an influencer marketplace that ran for over 10 months working with over 100 brands, including Hershey's, Bounce, and Raw Pressery, and on-boarded over 80,000 influencers. In February, they clocked over $150,000 in GMV and $37,000 in revenue, almost jumping 400 percent from the previous month. Since it pivoted, the platform has done 310 shoutouts. Influencer marketing has grown as an industry over the last few years from $1.7 billion in 2016 to $4.6 billion in 2018. According to reports, global influencer marketing is poised to be a $20 billion industry by 2020. Of this, India accounts for a fledgling chunk of between $75 and $150 million. 

Job Description

  • Create detailed, comprehensive and well-structured test plans and test cases for manual and automated testing.
  • Able to write idempotent Unit Test cases, integration test cases and browser automation test cases.
  • Provide post production support.
  • Test execution, defect (bug) tracking, reporting, and issue resolution/coordination.
  • Good to have expertise in Reactjs and Nodejs.
  • Knowledge of GIT and JIRA is must.
Skills Requirement
  • Experience in testing frameworks such as TestCafe, react testing library, enzyme.
  • Unit Testing (Mocha, Chai, JEST)
Read more
Casey Foods Opc Pvt Ltd
at Casey Foods Opc Pvt Ltd
14 recruiters
Hr Caseyfoods
Posted by Hr Caseyfoods
Odisha
3 - 6 yrs
₹2L - ₹3L / yr
Sales
Marketing
skill iconLeadership
Retail management
- To recruit sales managers for blocks- To trained and support them- To aware them their job role and responsibilities- To aware them their salary and targets- To focus over business development opportunities- To generate leads- To handle dealer, distributor network- To generate sales- To generate revenue- To achieve sales target through team
Read more
Promobi Technologies
at Promobi Technologies
1 video
15 recruiters
sakshi Rahate
Posted by sakshi Rahate
Pune
1 - 4 yrs
₹4L - ₹14L / yr
Blogging
Creative Writing
Content Writing
Technical Writing
Experience - 2 to 4 years Location - Pune We are looking for an expert and experienced Content Writer with a super creative bent of mind! Someone who would be able to produce high-quality and information-rich content including blogs, articles, press releases, and similar marketing documents, required to contribute to the overall success of our products. We assure an amazing work experience with a great opportunity to grow and prosper along with the company and the products! Key Responsibilities The individual role that you’ll play in our team: ● Working with internal teams on product and documentation requirements ● Writing easy-to-understand user interface text, online help and developer guides ● Develop engaging content for articles, blogs, stories, and social media to entice and engage customers ● Work with internal teams to obtain an in-depth understanding of the product and the documentation requirements ● Produce high-quality documentation that meets applicable standards and is appropriate for its intended audience ● Create tutorials to help end-users use a variety of applications ● Analyze existing and potential content, focusing on reuse and single-sourcing opportunities ● Ensure that content contains sufficient keywords for search engine optimization ● Study product samples and talk with product designers and developers ● Organize and write supporting documents for products ● Writes, schedules, and posts content online; maintains company web pages and blog(s) ● Select appropriate medium for message or audience, such as manuals or online videos ● Standardize content across platforms and media Skills and Experience ● Experience of 2+ yrs ● Excellent writing skills in a number of different styles/tones ● Proven work experience in technical writing of software documentation ● Ability to deliver high-quality documentation with attention to detail ● Ability to quickly grasp complex technical concepts and make them easily understandable in text and pictures ● Experience with social networks and the implementation of social media marketing ● Must have excellent sentence construction and grammar skills ● Should be able to work independently, delivering accurate documentation within the deadline ● An understanding of formatting articles on the web ● Prior experience in B2B SaaS content marketing would be an added advantage
Read more
Tardigrade Technologies Private Limited
bangalore
1 - 3 yrs
₹4L - ₹5L / yr
skill iconAngular (2+)
User Interface (UI) Development
skill iconHTML/CSS
Ionic
skill iconjQuery
+3 more
Minimum of 2+ years of professional experience in web or hybrid app development
Must have Skills
==============
Excellent understanding on fundamentals of Javascript, HTML5, CSS3
Proficient in Javascript/CSS frameworks like AngularJS (2+), jQuery, Bootstrap
Proficient understanding of code versioning tools, such as Git/SVN
Very good with data structures and algorithms
Excellent communication skills to interact with clients/stakeholders
Good to have Skills
=================
REST API development using NodeJS, MongoDB, Express
UX skills like prototyping or wireframing the UI requirements
Mobile App development using Phonegap or Ionic or React Native or Flutter
Responsibilities
==============
Communicating with the clients/stakeholders to understand the project requirements.
Delivering front-end solution, ensuring client satisfaction.
Leading the front-end team from a technical, architectural and quality perspective.
Collaborating with the backend developers to build REST APIs.
What you will get?
================
Flexible timings
Small team, hence quick growth
Training on latest technologies
Read more
RupeePro
at RupeePro
1 recruiter
Harsh Kathuria
Posted by Harsh Kathuria
Mumbai
1 - 3 yrs
₹2L - ₹3L / yr
Communication Skills
Business Development
Client Servicing
Sales
Lead Generation
RupeePro is a fast growing fin-tech startup based in Mumbai. We are creating India's biggest marketplace for retail investments and are growing fast. Founders have extensive experience with leading BFSI firms - ICICI bank & Reliance Capital and have successfully scaled earlier startups. We are looking for an awesome Relationship Manager to drive the Mutual Fund partner relationship thats key to our growth. The RM is required to onboard new partners and manage the partner relationships over the phone. This is a key position and we need someone with high energy & great communication skills. Experience in mutual fund/ financial services will be an advantage.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly. No 3rd party agencies here.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
21,01,133
Matches delivered
37,12,187
Network size
15,000
Companies hiring
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos