Big Data Engineer/Data Engineer
What we are solving
Welcome to today’s business data world where:
• Unification of all customer data into one platform is a challenge
• Extraction is expensive
• Business users do not have the time/skill to write queries
• High dependency on tech team for written queries
These facts may look scary but there are solutions with real-time self-serve analytics:
• Fully automated data integration from any kind of a data source into a universal schema
• Analytics database that streamlines data indexing, query and analysis into a single platform.
• Start generating value from Day 1 through deep dives, root cause analysis and micro segmentation
At Propellor.ai, this is what we do.
• We help our clients reduce effort and increase effectiveness quickly
• By clearly defining the scope of Projects
• Using Dependable, scalable, future proof technology solution like Big Data Solutions and Cloud Platforms
• Engaging with Data Scientists and Data Engineers to provide End to End Solutions leading to industrialisation of Data Science Model Development and Deployment
What we have achieved so far
Since we started in 2016,
• We have worked across 9 countries with 25+ global brands and 75+ projects
• We have 50+ clients, 100+ Data Sources and 20TB+ data processed daily
Work culture at Propellor.ai
We are a small, remote team that believes in
• Working with a few, but only with highest quality team members who want to become the very best in their fields.
• With each member's belief and faith in what we are solving, we collectively see the Big Picture
• No hierarchy leads us to believe in reaching the decision maker without any hesitation so that our actions can have fruitful and aligned outcomes.
• Each one is a CEO of their domain.So, the criteria while making a choice is so our employees and clients can succeed together!
To read more about us click here:
https://bit.ly/3idXzs0" target="_blank">https://bit.ly/3idXzs0
About the role
We are building an exceptional team of Data engineers who are passionate developers and wants to push the boundaries to solve complex business problems using the latest tech stack. As a Big Data Engineer, you will work with various Technology and Business teams to deliver our Data Engineering offerings to our clients across the globe.
Role Description
• The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analysing, and visualizing large sets of data to turn information into business insights
• Develop the software and systems needed for end-to-end execution on large projects
• Work across all phases of SDLC, and use Software Engineering principles to build scalable solutions
• Build the knowledge base required to deliver increasingly complex technology projects
• The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction.
Education & Experience
• B.Tech. or Equivalent degree in CS/CE/IT/ECE/EEE 3+ years of experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.
Must have (hands-on) experience
• Python and SQL expertise
• Distributed computing frameworks (Hadoop Ecosystem & Spark components)
• Must be proficient in any Cloud computing platforms (AWS/Azure/GCP) • Experience in in any cloud platform would be preferred - GCP (Big Query/Bigtable, Pub sub, Data Flow, App engine )/ AWS/ Azure
• Linux environment, SQL and Shell scripting Desirable
• Statistical or machine learning DSL like R
• Distributed and low latency (streaming) application architecture
• Row store distributed DBMSs such as Cassandra, CouchDB, MongoDB, etc
. • Familiarity with API design
Hiring Process:
1. One phone screening round to gauge your interest and knowledge of fundamentals
2. An assignment to test your skills and ability to come up with solutions in a certain time
3. Interview 1 with our Data Engineer lead
4. Final Interview with our Data Engineer Lead and the Business Teams
Preferred Immediate Joiners
About Propellor.ai
Who we are
At Propellor, we are passionate about solving Data Unification challenges faced by our clients. We build solutions using the latest tech stack. We believe all solutions lie in the congruence of Business, Technology, and Data Science. Combining the 3, our team of young Data professionals solves some real-world problems. Here's what we live by:
Skin in the game
We believe that Individual and Collective success orientations both propel us ahead.
Cross Fertility
Borrowing from and building on one another’s varied perspectives means we are always viewing business problems with a fresh lens.
Sub 25's
A bunch of young turks, who keep our explorer mindset alive and kicking.
Future-proofing
Keeping an eye ahead, we are upskilling constantly, staying relevant at any given point in time.
Tech Agile
Tech changes quickly. Whatever your stack, we adapt speedily and easily.
If you are evaluating us to be your next employer, we urge you to read more about our team and culture here: https://bit.ly/3ExSNA2. We assure you, it's worth a read!
Similar jobs
We're hiring an SEO Executive with 1-2 years of experience in on-page and off-page SEO. Join us immediately and help enhance our online presence!
Key Responsibilities:
- Keyword research and content optimization
- Link-building strategies
- Analyzing website performance
- Collaborating with content and marketing teams
Qualifications:
- 1-2 years of SEO experience
- Proficient with SEO tools (Google Analytics, Ahrefs, SEMrush)
- Ready to join immediately
- Must have expertise on both on-page and off-page activities
What you'll do:
- Work closely with product managers and engineers to design, implement, test, and continually improve scalable frontend and backend services.
- Develop products using agile methods and tools.
- Develop commercial-grade software that is user-friendly and suitable for a global audience.
- Plan, create, and execute (manual and automated) tests.
- Be involved and participate in the overall application lifecycle.
- Building reusable code and libraries for future use.
- Staying up to date with current technologies and providing insights on cutting-edge software approaches, architectures, and vendors.
- Ensure that non-functional requirements such as security, performance, maintainability, scalability, usability, and reliability are being considered when architecting solutions.
Skills you bring to the table:
- Fluency in any one of JavaScript, TypeScript, or Python.
- Strong problem-solving skills.
- Should have built large scalable enterprise applications from scratch.
- Strong experience in architectural patterns, High-level designs.
- Experience in NoSQL and SQL DBs.
- You have a knack for launching and iterating on products quickly with quality and efficiency
- Willingness to learn and ability to flourish in a dynamic, high-growth, entrepreneurial environment
- Hands-on, self-starter, capable of working independently
- True love for technology and what you do
- Maniacal attention to detail
- 3+ years of experience
Role - Manager (Programmatic)
About Company :-
Our Client is the world’s largest media investment company and is a part of WPP. In fact, we are responsible for one in every three ads you see globally. We are currently looking for a Manager -Social to join us. As part of the largest media agency in India, you’ll have the opportunity to leverage the scale that comes with the job. You will become an integral part of this growing team and will be working with both internal teams and external parties to ensure campaign delivery objectives are met.
This team is responsible for delivering international solutions, particularly in APAC & EMEA, with some global influence. You will enjoy working in a collaborative team environment and will hold a ‘can do’ attitude with the passion to learn and grow.
At APAC, our people are our strength, which is why fostering a culture of diversity and inclusion is important to us.
What your day job looks like at GroupM-Hub:
· Develop strong relationships with counterparts in Hub regional teams (Europe, U.S., Asia)
· Lead the training and growth of your local programmatic team
· Enforce DV360 and TrueView best practices with a focus on platform expertise, consistency, and quality of work delivery
· Be accountable for consistent work delivery to regional teams by ensuring a high quality of output
· Serve as point of escalation for your team and take ownership of resolving challenges
· Provide career development and coaching for your team
· Line manage 2-5 direct reports with as many as 10 indirect reports
· Provide timely and actionable feedback to the team to aid in their development, improvement, and progress. Provide awareness and recognition for jobs well done
· Provide support to in capacity planning & resource management for the team
· Present strong and effective communication across all level.
What you’ll bring:
· Working experience in Agency, Trading Desks or Programmatic Tech Partners
· Actual Campaign execution experience with most of the local programmatic players as well as measurement providers
· Familiar with DSP and exchange revenue streams and be able to negotiate trading benefits
· Existing relationships with publishers, programmatic product partners, as well as data providers in the local market
· Knowledge of different programmatic trading models and their implications to both advertiser’s inventory quality and publisher monetization strategies
· Being able to articulate difficult technical concepts to non-technical people such as explaining lookalike modeling and cookie mapping to the lay person.
Minimum qualifications:
· 3+ year's professional experience with digital media preferably within a media agency/trading desk
· Experience in Google Marketing Platform (DV360, CM, GA360).
· Experience in top AdTech & MarTech platforms.
· Experience in Client Decks, Programmatic Strategy, New Pitches, etc.
· Hands on experience and knowledge on programmatic platforms.
· Clear thought process & strategy to build on existing businesses.
· Competent in all Microsoft office software
· To engage regularly with the Imperia customers as defined by the contact policy and provide a Consistent & a Superior Digital Experience. Ensuring that customers get world-class services and their needs are understood and met through financial products that the Bank has to offer.
· To enhance Customer Relationship & while doing so, Educate, Encourage & Induce the customers to use the Digital mediums for their banking transactions/ needs, while keeping a "window' to talk to the bank whenever customer needs.
· Responsible for meeting the scorecard targets and portfolio benchmarks set and that all guidelines and regulatory requirements are followed.
What does the role look like?
We are looking for a high-energy, detail-oriented, and technically-savvy Quality Assurance Engineer (QAE). Should be an excellent individual contributor capable of understanding and driving test execution with minimal help. Who can work towards understanding application performance, functionality, and features to great depth enabling them to report issues, take ownership and drive them to closure.
What will you be doing?
Develop and execute automated tests and test plans
Efficiently execute test cases across all functional areas of the products(API and App)
Review product user interface for conformity to design guidelines
Find, isolate, document, regress, and track bugs through resolution
Interpret and report testing results, and be a vocal proponent for quality in every phase of the development process
Work with Engineering and product to understand the overall product requirements and technical architecture and how each feature is implemented
Ensure the highest quality product delivery with security.
Evaluating and integrate open source and in house developed toolsets
What will you need ?
Bachelor/Master degree in CS or related field from a reputed college
Experience in manual testing for Application and APIs
Experience in automation testing using available framework.
Strong knowledge of QA methodologies, testing frameworks and tools
Demonstrated experience in test planning, test design, test execution and reporting.
Excellence in technical communication with peers and non-technical partners.
Understanding & experience with software design pattern, restful APIs and microservice architecture
Prior experience in start-ups or health-tech will be a plus
JTC provides software solutions to enterprises across the world. We believe that we can only succeed if and only if we have a passionate driven, and capable team. People are at the core of who we are.
We are looking for a person who will be responsible to understand our core values and translate them to create a workplace where our team feels proud to come to work every day.
Responsibilities:
- Implement recruiting strategies to find the right person for each role in the organization, keeping diversity and inclusion as core values. This includes various activities such as sourcing candidates, scheduling interviews, and onboarding prospective team members.
- Build the company's brand as a strong engineering company by holding hackathons, engaging with various local engineering groups, and other related initiatives.
- Support HR functions (5% to 10%) when needed.
About you:
- You are passionate and driven to build a great team.
- You are someone who cares deeply about people and demonstrates deep empathy for team members of all backgrounds.
- You have a willingness to roll up your sleeves and help the team get work done.
What you'll gain:
- The ability to exercise creativity and leadership in your work.
- The chance to build a great team that is on a mission to make the world a better place.
- A team of highly selective, ambitious, and innovative co-workers.
Perks and Benefits:
- Remote Friendly: You can work from place of your choice, including one time work from home setup reimbursement at the time of joining.
- Comprehensive Health Insurance: INR 3L health insurance with a wide hospital coverage that covers your spouse, children and parents (with existing pre-conditions), including access to remote on call doctors.
- Workation: Annual off-sites every year, fully paid, for the team to get together for a week to work and play.
- Learning Opportunities: Access to best trainings for learning and skill advancements.
- Time Offs: 12 paid leaves, 6 leaves per year on top of National and Regional holidays.
- Paid Parental Leave: 6 months maternal and 1 month paternal.
Hiring Java Architects/ Tech Leads with expertise in Microservices, and Spring Framework. Experience of 8-10 yrs.
Notice Period - immediate to 45 days joiners only
Location - Bangalore and Chennai
- This position offers lot of learning of various aspects of hiring
- Skills Expected : good communciation skills, fast learner, people skills, prompt and go getter
- Candidates with immediate joining are a plus
- Experience in IT recruitment and senior management recruitment is a plus
You will be a part of: Supply Chain Management (SCM)
Myntra-Jabong Supply Chain Management systems form the backbone of our core business and customer experience. Any business runs on a simple construct of Demand (Consumer) and Supply (Producer). However, a set of complex and intricate methods, processes and systems connect the demand with supply in a deterministic and predictable way. These methods, processes and systems collectively form the Supply Chain for the business. The multi-billion-dollar Myntra-Jabong business fundamentally rests on a set of highly scalable, robust and intelligent Supply Chain Management systems that solve real-world problems of predicting the demand from millions of our customers, for a combination of millions of products from our product catalogue, and intelligently connecting that demand to thousands of national and international sellers or suppliers using a set of advanced homegrown tech products that we build and manage.
SCM engineering employs new-age technologies such as Distributed Computing constructs, Machine Learning, Deep Learning, Computer Vision, Artificial Intelligence; scalable data stores in Mongo, Redis, Cassandra, MySQL, Elastic Search, Solr; scalable programming constructs in Node.js, GoLang, Java; JavaScript, Python, and new-age frameworks such as ReactJS and ReactNative to solve some of the hardest problems in the e-commerce business
with world-class software products.
The SCM engineering at Myntra-Jabong operates within two distinct verticals: Supply-chain Outbound (Fulfilment systems) & Supply-chain Inbound (Selection systems, Partner experience).
Your Responsibilities:
● Own the architecture of Myntra’s new product platforms to drive business results
● Be a visible leader to drive and own the architecture and design of some of the most advanced & complex software systems / products in the industry to create company wide impact.
● Help build, mentor and coach a team of very talented Engineers, Architects, Quality engineers, System Operation Engineers and DevOps engineers in architectural and design best practices.
● Be an operational and technical leader with a passion for distributed systems, cloud service
development, deployment and delivery.
● Be accountable for the design, for the ease of evolution, quality of the systems, performance, scaling, and availability characteristics and limitations of the systems.
● Envision and develop the long-term architectural direction, with emphasis on platforms/ reusable components while adopting a nimble delivery process. Establish structures and processes that ensure a high level of quality and reliability and extensibility of deliverables.
● Drive the creation of next generation extensible web, mobile and fashion commerce platforms, security protocols, customisation and tools to support continuous scaling, internationalization and platform extensions
● Drive code and design reviews of components / systems / products in scope and drives the
architectural governance for them
● Set directional paths for the teams/department for adoption of new technology stacks for solving business problems
● Be a very visible representative of multiple technology domains and represent Myntra in external technical forums
● Work with product management, business stakeholders and other engineering leaders to help define mid-term, long-term roadmaps and shape business directions
● Initiate and deliver leadership training within the engineering organisation, including training new managers, and drive the growth of leaders to create a strong leadership bench
Desired Skills and Experience
● 12 - 16 years of experience in software product development
● Must have a degree in Computer Science or related field
● A solid engineer at heart with excellent abstraction, coding and system design skills
● Proven track record of leading the architecture and delivery in a startup/e-commerce ecosystem within a high growth & matrix environment
● Successfully architected and led technology for consumer-facing products in the global market along with being an efficient proficient problem-solver who envisions business and technical perspectives to develop workable solutions
● Must have exposure to leading product development end-end (portfolio to delivery, re-architectures)
● Strong hands-on technology experience building and running large scale systems handling
multi-million sessions/transactions per day
● Solid experience in large scale Database systems like RDBMS & NoSQL stores
● Strong design/development experience in building massively large scale distributed internet systems and products
● Excellent programming skills in Java/GO and expertise in multi-threading and performance-oriented programming
● Solid experience in Distributed systems, highly scalable products, performance & reliability
● Excellent understanding of processing platforms and queues
● Experience and knowledge of open source software, frameworks and broader cutting edge
technologies around server-side development in Java
● Strong understanding of object-oriented programming, concurrency and fundamentals of
computer-science