PythonBig Data Engineer/Data Engineer
What we are solving
Welcome to today’s business data world where:
• Unification of all customer data into one platform is a challenge
• Extraction is expensive
• Business users do not have the time/skill to write queries
• High dependency on tech team for written queries
These facts may look scary but there are solutions with real-time self-serve analytics:
• Fully automated data integration from any kind of a data source into a universal schema
• Analytics database that streamlines data indexing, query and analysis into a single platform.
• Start generating value from Day 1 through deep dives, root cause analysis and micro segmentation
At Propellor.ai, this is what we do.
• We help our clients reduce effort and increase effectiveness quickly
• By clearly defining the scope of Projects
• Using Dependable, scalable, future proof technology solution like Big Data Solutions and Cloud Platforms
• Engaging with Data Scientists and Data Engineers to provide End to End Solutions leading to industrialisation of Data Science Model Development and Deployment
What we have achieved so far
Since we started in 2016,
• We have worked across 9 countries with 25+ global brands and 75+ projects
• We have 50+ clients, 100+ Data Sources and 20TB+ data processed daily
Work culture at Propellor.ai
We are a small, remote team that believes in
• Working with a few, but only with highest quality team members who want to become the very best in their fields.
• With each member's belief and faith in what we are solving, we collectively see the Big Picture
• No hierarchy leads us to believe in reaching the decision maker without any hesitation so that our actions can have fruitful and aligned outcomes.
• Each one is a CEO of their domain.So, the criteria while making a choice is so our employees and clients can succeed together!
To read more about us click here:
https://bit.ly/3idXzs0" target="_blank">https://bit.ly/3idXzs0
About the role
We are building an exceptional team of Data engineers who are passionate developers and wants to push the boundaries to solve complex business problems using the latest tech stack. As a Big Data Engineer, you will work with various Technology and Business teams to deliver our Data Engineering offerings to our clients across the globe.
Role Description
• The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analysing, and visualizing large sets of data to turn information into business insights
• Develop the software and systems needed for end-to-end execution on large projects
• Work across all phases of SDLC, and use Software Engineering principles to build scalable solutions
• Build the knowledge base required to deliver increasingly complex technology projects
• The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction.
Education & Experience
• B.Tech. or Equivalent degree in CS/CE/IT/ECE/EEE 3+ years of experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.
Must have (hands-on) experience
• Python and SQL expertise
• Distributed computing frameworks (Hadoop Ecosystem & Spark components)
• Must be proficient in any Cloud computing platforms (AWS/Azure/GCP) • Experience in in any cloud platform would be preferred - GCP (Big Query/Bigtable, Pub sub, Data Flow, App engine )/ AWS/ Azure
• Linux environment, SQL and Shell scripting Desirable
• Statistical or machine learning DSL like R
• Distributed and low latency (streaming) application architecture
• Row store distributed DBMSs such as Cassandra, CouchDB, MongoDB, etc
. • Familiarity with API design
Hiring Process:
1. One phone screening round to gauge your interest and knowledge of fundamentals
2. An assignment to test your skills and ability to come up with solutions in a certain time
3. Interview 1 with our Data Engineer lead
4. Final Interview with our Data Engineer Lead and the Business Teams
Preferred Immediate Joiners
Shubham Vishwakarma
Full Stack Developer - Averlon
About Propellor.ai
About
Who we are
At Propellor, we are passionate about solving Data Unification challenges faced by our clients. We build solutions using the latest tech stack. We believe all solutions lie in the congruence of Business, Technology, and Data Science. Combining the 3, our team of young Data professionals solves some real-world problems. Here's what we live by:
Skin in the game
We believe that Individual and Collective success orientations both propel us ahead.
Cross Fertility
Borrowing from and building on one another’s varied perspectives means we are always viewing business problems with a fresh lens.
Sub 25's
A bunch of young turks, who keep our explorer mindset alive and kicking.
Future-proofing
Keeping an eye ahead, we are upskilling constantly, staying relevant at any given point in time.
Tech Agile
Tech changes quickly. Whatever your stack, we adapt speedily and easily.
If you are evaluating us to be your next employer, we urge you to read more about our team and culture here: https://bit.ly/3ExSNA2. We assure you, it's worth a read!
Tech stack
Python
Machine Learning (ML)Company video
Candid answers by the company
Photos
Company social profiles
Similar jobs
Java
KubernetesPythonSoftware Engineer
Challenge convention and work on cutting edge technology that is transforming the way our customers manage their physical, virtual and cloud computing environments. Virtual Instruments seeks highly talented people to join our growing team, where your contributions will impact the development and delivery of our product roadmap. Our award-winning Virtana Platform provides the only real-time, system-wide, enterprise scale solution for providing visibility into performance, health and utilization metrics, translating into improved performance and availability while lowering the total cost of the infrastructure supporting mission-critical applications.
We are seeking an individual with knowledge in Systems Management and/or Systems Monitoring Software and/or Performance Management Software and Solutions with insight into integrated infrastructure platforms like Cisco UCS, infrastructure providers like Nutanix, VMware, EMC & NetApp and public cloud platforms like Google Cloud and AWS to expand the depth and breadth of Virtana Products.
Work Location- Pune/ Chennai
Job Type- Hybrid
Role Responsibilities:
- The engineer will be primarily responsible for design and development of software solutions for the Virtana Platform
- Partner and work closely with team leads, architects and engineering managers to design and implement new integrations and solutions for the Virtana Platform.
- Communicate effectively with people having differing levels of technical knowledge.
- Work closely with Quality Assurance and DevOps teams assisting with functional and system testing design and deployment
- Provide customers with complex application support, problem diagnosis and problem resolution
Required Qualifications:
- Minimum of 4+ years of experience in a Web Application centric Client Server Application development environment focused on Systems Management, Systems Monitoring and Performance Management Software.
- Able to understand and comprehend integrated infrastructure platforms and experience working with one or more data collection technologies like SNMP, REST, OTEL, WMI, WBEM.
- Minimum of 4 years of development experience with one of these high level languages like Python, Java, GO is required.
- Bachelor’s (B.E, B.Tech) or Master’s degree (M.E, M.Tech. MCA) in computer science, Computer Engineering or equivalent
- 2 years of development experience in public cloud environment using Kubernetes etc (Google Cloud and/or AWS)
Desired Qualifications:
- Prior experience with other virtualization platforms like OpenShift is a plus
- Prior experience as a contributor to engineering and integration efforts with strong attention to detail and exposure to Open-Source software is a plus
- Demonstrated ability as a strong technical engineer who can design and code with strong communication skills
- Firsthand development experience with the development of Systems, Network and performance Management Software and/or Solutions is a plus
- Ability to use a variety of debugging tools, simulators and test harnesses is a plus
About Virtana: Virtana delivers the industry’s only broadest and deepest Observability Platform that allows organizations to monitor infrastructure, de-risk cloud migrations, and reduce cloud costs by 25% or more.
Over 200 Global 2000 enterprise customers, such as AstraZeneca, Dell, Salesforce, Geico, Costco, Nasdaq, and Boeing, have valued Virtana’s software solutions for over a decade.
Our modular platform for hybrid IT digital operations includes Infrastructure Performance Monitoring and Management (IPM), Artificial Intelligence for IT Operations (AIOps), Cloud Cost Management (Fin Ops), and Workload Placement Readiness Solutions. Virtana is simplifying the complexity of hybrid IT environments with a single cloud-agnostic platform across all the categories listed above. The $30B IT Operations Management (ITOM) Software market is ripe for disruption, and Virtana is uniquely positioned for success.
HTML/CSS
PHP- Should be able to write APIs and connect with external systems
- Should be able to develop plugins or modify existing plugins
Note: This is not a WordPress management role. Development experience is a must.
1. Research for relevant resumes from various job portals
2. Shortlisting of relevant candidates and sharing it with the HR team
3. Connecting to the candidates and collecting data for analysis of the profile
4. Doing the first round of interviews to ascertain that the JD requirements are met
5. Aligning online/physical interview with the candidates with the HR/Operations team
6. Roll out offer letters & relevant joining documents and receive acceptance
7. Ascertain reporting to work on the joining date
JavascriptJava
NodeJS (Node.js)We have openings for Fullstack / Backend / Frontend Developers who can write reliable, scalable, testable and maintainable code.
At Everest, we innovate at the intersection of design and engineering to produce outstanding products. The work we do is meaningful and challenging - which makes it interesting. Imagine each line of your code, making the world a better place. We work on five workdays weeks, and overtime is a rarity. If clean architecture, TDD, DDD, DevOps, Microservices, Micro-frontends, scalable systems resonate with you, please apply.
To see the quality of our code, you can checkout some of our open source projects: https://github.com/everest-engineering
If you want to know more about our culture:
https://github.com/everest-engineering/manifesto
Some videos that can help:
https://www.youtube.com/watch?v=A7y9RpqXAdA;
https://youtu.be/PPjyP1WPOn8" target="_blank">https://youtu.be/PPjyP1WPOn8
- Passion to own and create amazing product.
- Should be able to clearly understand the customer's problem.
- Should be a collaborative problem solver.
- Should be able a team player.
- Should be open to learn from others and teach others.
- Should be a good problem solver.
- Should be able to take feedback and improve continuously.
- Should commit to inclusion, equity & diversity.
- Should maintain integrity at work
-
Familiarity with Agile methodologies and clean code.
-
Design and/or contribute to client-side and server-side architecture.
-
Well versed with fundamentals of REST.
-
Build the front-end of applications through appealing visual design.
-
Knowledge of one or more front-end languages and libraries (e.g. HTML / CSS, JavaScript, XML, jQuery, Typescript) JavaScript frameworks (e.g. Angular, React, Redux, Vue.js)
-
Knowledge of one or more back-end languages (e.g. C#, Java, Python, Go, Node.js and frameworks like SpringBoot, .NET Core)
-
Well versed with fundamentals of database design.
-
Familiarity with databases - RDBMS like MySQL, Postgres & NoSQL like MongoDB, DynamoDB.
-
Well versed with one or more cloud platforms like - AWS, Azure, GCP.
-
Familiar with Infrastructure as Code - CloudFormation & Terraform & deployment tools like Docker, Kubernetes.
-
Familiarity with CI/CD tools like Jenkins, CircleCI, Github Actions..
-
Unit testing tools like Junit, Mockito, Chai, Mocha, Jest
As a Power Apps Developer for PreludeSys, you will:
· Understanding BRD and detail design documents and overall architecture of the application being worked on.
· Creating, modifying and upgrading canvas, model and portal applications as per the specifications and needs of the customer within the timeframe specified.
· Look at the defects, issues raised and fix it within the assigned SLA. Periodically review metrics to understand gaps and equip with training, Online courses.
· Process Improvement, Suggestion of tools, Identifying automation, reusable opportunities. Support organizational initiatives and be an enthusiastic participant.
· Keep all the stakeholders aware of the Update on Progress, Issues, Clarifications, Dependencies in a short but complete status update. Guiding the team on technical challenges.
You Are Great At:
· Power Apps developer with 2+ years of work experience in Power Apps.
· Experience in creating Canvas, Model and Portal applications.
In-Depth Knowledge of Power Automate.
· Used dataverse, Approval flows, connectors.
Created both basic, Advanced forms for Portal, Familiar with UI Customization, Liquid Code.
Must Have:
· Bachelor’s degree in software engineering, computer science or similar program
· 5 to 7 Years of work experience
· In-Depth Knowledge in Power Apps concepts
· Experience with Power Apps,Power Automate
· Knowledge on Agile concepts
· Excellent Oral and Written Communication skills
Headquartered in Redwood city, CA, our client is a communication and assessment SaaS startup that enables the movement health professional (athletic trainer, physical therapist, recovery specialist) to seamlessly capture and assess patient care data through cutting edge technologies such as machine learning and AI. It improves outcomes for healthcare organisations by identifying early signs of clinical deterioration in chronically-ill patients thereby decreasing hospital admissions and reducing unnecessary spending.
This revolutionary startup has raised $3 Mn in a seed funding round led by top investors. It is all set to democratise the accessibility and affordability of movement health through its full stack digital health platform.
What you will do:
- Handling multiple projects end to end across multiple domains with cross-functional teams (Engineering, Quality, Design, etc)
- Analyzing business requirements preparing project plan ensuring the smooth delivery of projects and day to day project management activities
- Participating in client calls to discuss the nature, urgency and root cause of the problems and appropriately taking decisions in collaboration with clients
- Identifying project roadblocks, risks, and mitigation plan, keeping track of tasks, defects assigned to the team
- Working closely with technical development teams on estimation, technical assessments and setting up backlogs/project plan
- Hosting internal and external customer demos at various points along with managing project status on Project Management tools and collaboration tools
- Identifying scope change and leading efforts to develop, estimate, and communicate budget and schedule impacts
- Working with management on resource allocation, feedback, and process improvements
- Driving prompt resolution of customer issues and ensuring high levels of customer satisfaction
- Selecting appropriate project management approaches (Agile and/or Waterfall) based on customer and project requirements
Desired Candidate Profile
What you need to have:- Bachelor of Technology in Computer Science/ Engineering/ MCA
- 4+ years of experience on Project/Program Management roles working on managing complete development cycle of SaaS products/applications
- Certification in Scrum Master
- Knowledge of Project Management tools such as JIRA
- Software Development or QA Engineer background is a plus
- Ability to transform raw thoughts into clear technical documentation and/or direction
- Problem-solving capabilities with the ability to identify root cause, patience and commitment to solve
- Excellent verbal and written communication, presentation and articulation skills
Responsibilities
- Help define Technical Roadmap and own the entire product delivery end to
- Work very closely with various business stakeholders to drive the execution of multiple business plans and
- Improve, optimize and identify opportunities for efficient software development processes
- Hire, Develop and Retain a strong team of
- Keep abreast of the changes in the industry and champion new technologies and development processes within the team
- Thinking backwards from a customer POV and relentlessly pursuing customer's cause in tech and product
Appy if you have
- A graduation/post graduation degree in Computer Science (IITs, IIITs and NITs preferred)
- 7-12 years of strong experience in various frontend development technologies which includes Javascript (core and oops), Nodejs, Html, Css
- Expertise in
- Any UI framework React/Vue
- State Management libraries like redux
- Build tools (webpack, grunt, gulp etc)
- Experience with
- best practices for JS development using jslint, testing frameworks etc.
- package managers like npm or yarn
- Experience working with agile teams and making rapid decisions in dynamic and disruptive environments.
- 2+ years of leading and managing a team consisting of backend, frontend and QA.
- Hands on writing and reviewing code
- Exceptional design and architectural skills.
- Strong communication skills.
Good to have
- Experience with AWS, Microfrontend, Nginx, CDN caching
- Exposure to Performance optimization techniques/tools (caching, cdn, lighthouse, optimization)
- Experience with Dockers & Containerization
- Knowledge of tools and best practices for Linting, Compiling, Minifying, Jenkins etc.
- Experience with "Micro Frontend architecture" & “Backend For Frontend”
About:
Saraverse is India's first open-metaverse and avatar-based social network where people can create fun versions of themselves known as SARAs, make friends, buy lands, play, and create games.
We are looking for a creative, motivated, and highly organized individual to join our Engineering Team at SaraVerse, which covers:
Manage processes, people, and technology
↳ Process: what occurs when?
↳ People: who's involved and how are they motivated?
↳ Technology: What will we use to get there? Work with founders on company strategy to balance product priorities with business objectives
Define the technology landscape in terms of architecture and choice of tech stack.
Increase product velocity while maintaining a high bar for quality
Recruit and retain a next-level team
Help build a culture that balances innovation, diversity, and execution
Build relationships internally and externally, including but not limited to users, customers, partners, and developers
Requirements:
Personal
Savvy - You're fluent with different technologies, and while mastering some of them, you are keen on trying out the most recent tools and methods as soon as they emerge.
Architect - You love to build and design larger products and ecosystems of different sizes of components, and value simplicity over complexity.
Hackers - You love to test your mind and skillset from time to time by squeezing out everything you've got to build radically new Proof-of-Concept in a short period of time.
Experience as a head of engineering or engineering leader at an early stage startup (managing over 25+ people)
Terminal
You're fluent with Node, React, JavaScript, and different query languages
5+ years of experience as an individual contributor building full-stack web and mobile software products that are robust and scalable.
You've built products and understand software architecture
You've shipped software and are familiar with cloud computing and DevOps
You're interested in blockchain technology and would like to delve into it
You like to keep things organized to track and develop your coding flow
Experience with decentralized smart contract networks (eg Ethereum, Polygon)
Proficiency in modern programming languages such as Go, Rust, and Node
Familiarity with Go and the Kubernetes ecosystem, but you don’t necessarily need to be an expert
Experience containerizing modern applications, particularly distributed systems like blockchain networks (though experience with blockchain networks, in particular, is not a requirement)
Design and implement foundational protocol integrations powering our NFT community platform. This includes but is not limited to Layer 1 blockchain integrations, Layer 2 scaling solutions, and sidechains
Actively participate in the blockchain network community including but not limited to joining third party communities and discussions as well as contributing directly to new protocols and network initiatives aligned with the Saraverse mission
Design and develop a service architecture that helps automate the deployment and monitoring of blockchain networks and protocol infrastructure including the full lifecycle of transactions Saraverse would send/receive on-chain
Develop a monitoring, alerting, and observability framework to maintain consistent user experience and site reliability across various traditional and blockchain-enabled payment networks
Bonus:
Worked on self-sovereign identity projects
Worked with gaming companies.
JavascriptHTML/CSS
Angular (2+)NodeJS (Node.js)UI Architect / Developer
1. A must have skills is Angular. NodeJs preferred but can be replaced with anything on server side scripting.
a. 70% work for this role in angular based. At architect role without server side scripting understanding doesn’t a right fit.
b. Someone who can take sound decision for overall interaction with backend.
c. There are components written in node (Control Manager and aith server) which we have intentions to align with UI architect.
d. Given Node is technology primary in java script (same as angular), generally we are seeing people who have earlier exposure or are confident to pick it with little learning. But we would not penalize anyone who is week in node, but champ in angular for this role.
2. Design , develop and maintain client facing web applications.
3. Cooperating with backend developers in the process of building REST APIs.
4. Should demonstrate deep understanding of the following:
· Design - HTML/CSS
· Frontend languages - Experience with Javascript and related frameworks - Angular(7/8/9), Angular Material, Bootstrap(or similar CSS frameworks), Node JS (preferred but not mandatory).
· Test frameworks - Mocha, Chai, Jasmine, Karma
To be shared by you -
1. Can you lead frontend-backend integration?
2. Can you use linux machines?
3. Are you aware of websockets?
4. Has you workedon binary data communication over websockets?
5. Do you understand different types of communication protocols available between frontend-backend and it's working?
6. Do you have experience on electron framework?
7. Highest team size managed by you.
- Support for Incident and Request management tasks as assigned.
- Administration and understanding of the following network services to support Incident and Request tasks as assigned:
- Palo Alto Firewalls
- LAN Routing and Switching
- Microsoft Azure Networking – Vnets, Express Route, Vnet Peering, VPN Gateways
- LAN to LAN VPN Tunnels
- Arista Network devices
- Work with Networking Monitoring tools such as one or more of the following: Solar Winds, Splunk, Prime, NetMRI, Nagios
- Work directly with telecom carriers and Network infrastructure maintenance providers as needed, such as Verizon, Tata, Bharti, and Cisco.
- Maximize network performance by monitoring performance, troubleshooting network problems and outages, scheduling upgrades, and collaborating with network architects on network optimization
- Supports routing and switching and work on BGP, OSPF protocols
- Support China retail store infrastructure and data center through on-call rotations
QUALIFICATIONS:
- Graduate or above
- 6-7 years experience in LAN/WAN Routing including 2 or more years of LAN/WAN Administration experience within a multi-platform technical environment.
- In-depth understanding of voice and/or data technologies and subject matter expert in at least one area.
- Cisco Certified or equivalent combination of knowledge and experience.
- Understanding on IPsec, VPNs, GRE, NAT/PAT over varied platforms
- Expert knowledge of all LAN switching technologies eg Spanning Tree, VLAN management, and VTP concepts on Cisco, Nexus, and Arista
- Good understanding of MPLS routing and OSPF routing
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon