PythonBig Data Engineer/Data Engineer
What we are solving
Welcome to today’s business data world where:
• Unification of all customer data into one platform is a challenge
• Extraction is expensive
• Business users do not have the time/skill to write queries
• High dependency on tech team for written queries
These facts may look scary but there are solutions with real-time self-serve analytics:
• Fully automated data integration from any kind of a data source into a universal schema
• Analytics database that streamlines data indexing, query and analysis into a single platform.
• Start generating value from Day 1 through deep dives, root cause analysis and micro segmentation
At Propellor.ai, this is what we do.
• We help our clients reduce effort and increase effectiveness quickly
• By clearly defining the scope of Projects
• Using Dependable, scalable, future proof technology solution like Big Data Solutions and Cloud Platforms
• Engaging with Data Scientists and Data Engineers to provide End to End Solutions leading to industrialisation of Data Science Model Development and Deployment
What we have achieved so far
Since we started in 2016,
• We have worked across 9 countries with 25+ global brands and 75+ projects
• We have 50+ clients, 100+ Data Sources and 20TB+ data processed daily
Work culture at Propellor.ai
We are a small, remote team that believes in
• Working with a few, but only with highest quality team members who want to become the very best in their fields.
• With each member's belief and faith in what we are solving, we collectively see the Big Picture
• No hierarchy leads us to believe in reaching the decision maker without any hesitation so that our actions can have fruitful and aligned outcomes.
• Each one is a CEO of their domain.So, the criteria while making a choice is so our employees and clients can succeed together!
To read more about us click here:
https://bit.ly/3idXzs0" target="_blank">https://bit.ly/3idXzs0
About the role
We are building an exceptional team of Data engineers who are passionate developers and wants to push the boundaries to solve complex business problems using the latest tech stack. As a Big Data Engineer, you will work with various Technology and Business teams to deliver our Data Engineering offerings to our clients across the globe.
Role Description
• The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analysing, and visualizing large sets of data to turn information into business insights
• Develop the software and systems needed for end-to-end execution on large projects
• Work across all phases of SDLC, and use Software Engineering principles to build scalable solutions
• Build the knowledge base required to deliver increasingly complex technology projects
• The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction.
Education & Experience
• B.Tech. or Equivalent degree in CS/CE/IT/ECE/EEE 3+ years of experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.
Must have (hands-on) experience
• Python and SQL expertise
• Distributed computing frameworks (Hadoop Ecosystem & Spark components)
• Must be proficient in any Cloud computing platforms (AWS/Azure/GCP) • Experience in in any cloud platform would be preferred - GCP (Big Query/Bigtable, Pub sub, Data Flow, App engine )/ AWS/ Azure
• Linux environment, SQL and Shell scripting Desirable
• Statistical or machine learning DSL like R
• Distributed and low latency (streaming) application architecture
• Row store distributed DBMSs such as Cassandra, CouchDB, MongoDB, etc
. • Familiarity with API design
Hiring Process:
1. One phone screening round to gauge your interest and knowledge of fundamentals
2. An assignment to test your skills and ability to come up with solutions in a certain time
3. Interview 1 with our Data Engineer lead
4. Final Interview with our Data Engineer Lead and the Business Teams
Preferred Immediate Joiners
Shubham Vishwakarma
Full Stack Developer - Averlon
About Propellor.ai
About
Who we are
At Propellor, we are passionate about solving Data Unification challenges faced by our clients. We build solutions using the latest tech stack. We believe all solutions lie in the congruence of Business, Technology, and Data Science. Combining the 3, our team of young Data professionals solves some real-world problems. Here's what we live by:
Skin in the game
We believe that Individual and Collective success orientations both propel us ahead.
Cross Fertility
Borrowing from and building on one another’s varied perspectives means we are always viewing business problems with a fresh lens.
Sub 25's
A bunch of young turks, who keep our explorer mindset alive and kicking.
Future-proofing
Keeping an eye ahead, we are upskilling constantly, staying relevant at any given point in time.
Tech Agile
Tech changes quickly. Whatever your stack, we adapt speedily and easily.
If you are evaluating us to be your next employer, we urge you to read more about our team and culture here: https://bit.ly/3ExSNA2. We assure you, it's worth a read!
Tech stack
Python
Machine Learning (ML)Company video
Candid answers by the company
Photos
Company social profiles
Similar jobs
HTML/CSS
JavascriptPython
NodeJS (Node.js)Responsibilities :
- Design and develop user-friendly web interfaces using HTML, CSS, and JavaScript.
- Utilize modern frontend frameworks and libraries such as React, Angular, or Vue.js to build dynamic and responsive web applications.
- Develop and maintain server-side logic using programming languages such as Java, Python, Ruby, Node.js, or PHP.
- Build and manage APIs for seamless communication between the frontend and backend systems.
- Integrate third-party services and APIs to enhance application functionality.
- Implement CI/CD pipelines to automate testing, integration, and deployment processes.
- Monitor and optimize the performance of web applications to ensure a high-quality user experience.
- Stay up-to-date with emerging technologies and industry trends to continuously improve development processes and application performance.
Qualifications :
- Bachelors/master's in computer science or related subjects or hands-on experience demonstrating working understanding of software applications.
- Knowledge of building applications that can be deployed in a cloud environment or are cloud native applications.
- Strong expertise in building backend applications using Java/C#/Python with demonstrable experience in using frameworks such as Spring/Vertx/.Net/FastAPI.
- Deep understanding of enterprise design patterns, API development and integration and Test-Driven Development (TDD)
- Working knowledge in building applications that leverage databases such as PostgreSQL, MySQL, MongoDB, Neo4J or storage technologies such as AWS S3, Azure Blob Storage.
- Hands-on experience in building enterprise applications adhering to their needs of security and reliability.
- Hands-on experience building applications using one of the major cloud providers (AWS, Azure, GCP).
- Working knowledge of CI/CD tools for application integration and deployment.
- Working knowledge of using reliability tools to monitor the performance of the application.
HTML/CSSJavascript
Angular (2+)
AngularJS (1.x)Lead Developer Job Summary
We are looking for an experienced Lead Developer to be responsible for managing the development team and overseeing the development of software applications and systems. The Lead Developer will be expected to collaborate with stakeholders to ensure that the development team is meeting deadlines and requirements and will be responsible for designing and implementing new software solutions.
Lead Developer Duties and Responsibilities
- Lead and manage the development team, providing guidance, mentorship, and support
- Design and develop new software solutions and maintain existing software systems
- Identify development opportunities and prioritize projects
- Collaborate with stakeholders to ensure that the team meets deadlines and requirements
- Provide technical oversight and ensure software quality standards are met
- Develop and manage project plans and timelines
- Also perform some hands-on development
- Monitor project progress and provide regular updates
Lead Developer Requirements and Qualifications
- Bachelor’s degree in computer science, Engineering, or related field
- 5+ years of experience in software development and project management
- Experience leading a development team
- Working knowledge of software development processes and methodologies
- Full stack developer with experience working in .NET and Angular
Kubernetes
Amazon Web Services (AWS)Required Skills:
- Experience in systems administration, SRE or DevOps focused role
- Experience in handling production support (on-call)
- Good understanding of the Linux operating system and networking concepts.
- Demonstrated competency with the following AWS services: ECS, EC2, EBS, EKS, S3, RDS, ELB, IAM, Lambda.
- Experience with Docker containers and containerization concepts
- Experience with managing and scaling Kubernetes clusters in a production environment
- Experience building scalable infrastructure in AWS with Terraform.
- Strong knowledge of Protocol-level such as HTTP/HTTPS, SMTP, DNS, and LDAP
- Experience monitoring production systems
- Expertise in leveraging Automation / DevOps principles, experience with operational tools, and able to apply best practices for infrastructure and software deployment (Ansible).
- HAProxy, Nginx, SSH, MySQL configuration and operation experience
- Ability to work seamlessly with software developers, QA, project managers, and business development
- Ability to produce and maintain written documentation
REQUIRE TRAVEL EXECUTIVE
SKILLS- RESERVATION, TICKETING, PACKAGES
GENDER- MALE
EDUCATION- GRADUATE
EXPERIENCE- 3 YEARS
LOCATION- PITAMPURA, DELHI
SALARY –UPTO 40K
REQUIRE TRAVEL EXECUTIVE
SKILLS- RESERVATION, TICKETING, PACKAGES
GENDER- ANY
EDUCATION- GRADUATE
EXPERIENCE- 3 YEARS
LOCATION- Navi mumbai
SALARY –UPTO 35K
Talent Acquisition:
● Create a network of talent from multiple disciplines
● Creatively and innovatively communicate about the company and the positions to
candidates of all departments (tech/nontech) and all levels
● Focus on giving candidates a good hiring experience
● Tactical to create a healthy pool from different channels for multiple positions at
the same time
● Network with other peer recruiters to groom your skills
Generalist Role:
● Create organization-wide policies and making sure 100% adherence
● Handle payroll and other statutory compliances
● Ensure the entire team is aligned with the vision and mission of the company
● Support micro teams with their specific people-related problems
● Create performance metrics, track, monitor and improve the performance of teams
and team members
Who are you?
To be successful in this role, you:
● Have 4+ years of experience hiring tech/nontech roles for product
companies/startups
● Are Creative, curious and enthusiastic
● Great communication skills (verbal and written)
● Are charismatic people person who can talk to anyone;
● Have exceptional analytical skills
● You are someone who is high on ownership and takes pride in building great
teams.
● You understand the business needs and priorities to help get the right people in
team
● Have a strong entrepreneurial spirit and the ability to creatively think and hustle to
achieve goals
iOS App Development
Objective C
SwiftStrategic planning
Coaching and consulting leadership about HR matters
Building a competitive organization
Being a company culture and employee experience champion
Go Programming (Golang)
JavaPython
Ruby
Ruby on Rails (ROR)3+ years of hands-on experience in Go Lang & its design patterns
Worked in telecom domain
Good understanding of events & handler
Strong understanding & hands on experience in concurrency, go routines & channels
Strong understanding & hands on experience in Spring frameworks and their modules
Integration experience with REST or SOAP APIs
Strong hands-on experience in webservices and API
Good to have:
Docker & Kubernetes
Python development knowledge
Experience in Cloud technologies
Soft Skills:
Good communication skills & presentation skills.
Self-driven work attitude
Should be independently able to drive the tasks.
- Meeting with clients to discuss website design and function.
- Designing and building the website front-end.
- Creating the website architecture.
- Designing and managing the website back-end including database and server integration.
- Generating WordPress themes and plugins.
- Conducting website performance tests.
- Troubleshooting content issues.
- Conducting WordPress training with the client.
- Monitoring the performance of the live website.
.NET
C#Duties and responsibilities
- Develop and maintain simple to complex .net applications
- Deliver the quality code, on time
- Participate in agile development process to ensure project deliverables are met, on time and of high quality
- The quality and completeness of assignments, including initial design, development, bug fixing, quality engineering, documentation, and general product maintenance
- To understand specification document and perform coding as per the design and standards & guide lines which are defined by Immediate Lead/Manager
- Doing impact analysis and resolving in-process problems independently, or with minor input from the senior engineering /technical lead Skills and Experience
Skills
- Minimum 3 years of Experience in .Net Framework, C#,ASP.Net,
- In depth knowledge and experience with web development technologies including ASP.NET, Web API
- Have strong concepts of OOPS, Database(T-SQL) Programming
- Excellent analytical and problem-solving skills
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon