Big Data/Java Programming

Job Description

 

Mandatory Requirements 

• Experience in AWS Glue

• Experience in Apache Parquet 

• Proficient in AWS S3 and data lake 

• Knowledge of Snowflake

• Understanding of file-based ingestion best practices.

• Scripting language - Python & pyspark

CORE RESPONSIBILITIES

• Create and manage cloud resources in AWS 

• Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies 

• Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform 

• Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations 

• Develop an infrastructure to collect, transform, combine and publish/distribute customer data.

• Define process improvement opportunities to optimize data collection, insights and displays.

• Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible 

• Identify and interpret trends and patterns from complex data sets 

• Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders. 

• Key participant in regular Scrum ceremonies with the agile teams  

• Proficient at developing queries, writing reports and presenting findings 

• Mentor junior members and bring best industry practices.

 

QUALIFICATIONS

• 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales) 

• Strong background in math, statistics, computer science, data science or related discipline

• Advanced knowledge one of language: Java, Scala, Python, C# 

• Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake  

• Proficient with

• Data mining/programming tools (e.g. SAS, SQL, R, Python)

• Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

• Data visualization (e.g. Tableau, Looker, MicroStrategy)

• Comfortable learning about and deploying new technologies and tools. 

• Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines. 

• Good written and oral communication skills and ability to present results to non-technical audiences 

• Knowledge of business intelligence and analytical tools, technologies and techniques.

Familiarity and experience in the following is a plus: 

• AWS certification

• Spark Streaming 

• Kafka Streaming / Kafka Connect 

• ELK Stack 

• Cassandra / MongoDB 

• CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

Role and Responsibilities

• Own the product analytics of bidgely’s end user-facing products, measure and identify areas of improvement through data
• Liaise with Product Managers and Business Leaders to understand the product issues, priorities and hence support them through relevant product analytics
• Own the automation of product analytics through good SQL knowledge
• Develop early warning metrics for production and highlight issues and breakdowns for resolution
• Resolve client escalations and concerns regarding key business metrics
• Define and own execution
• Own the Energy Efficiency program designs, dashboard development, and monitoring of existing Energy efficiency program
• Deliver data-backed analysis and statistically proven solutions
• Research and implement best practices
• Mentor team of analysts

Qualifications and Education Requirements

• B.Tech from a premier institute with 5+ years analytics experience or Full-time MBA from a premier b-school with 3+ years of experience in analytics/business or product analytics
• Bachelor's degree in Business, Computer Science, Computer Information Systems, Engineering, Mathematics, or other business/analytical disciplines

Skills needed to excel

• Proven analytical and quantitative skills and an ability to use data and metrics to back up assumptions, develop business cases, and complete root cause
  analyses
• Excellent understanding of retention, churn, and acquisition of user base
• Ability to employ statistics and anomaly detection techniques for data-driven
  analytics
• Ability to put yourself in the shoes of the end customer and understand what
  “product excellence” means
• Ability to rethink existing products and use analytics to identify new features and product improvements.
• Ability to rethink existing processes and design new processes for more effective analyses
• Strong SQL knowledge, working experience with Looker and Tableau a great plus
• Strong commitment to quality visible in the thoroughness of analysis and techniques employed
• Strong project management and leadership skills
• Excellent communication (oral and written) and interpersonal skills and an ability to effectively communicate with both business and technical teams
• Ability to coach and mentor analysts on technical and analytical skills
• Good knowledge of statistics, basic machine learning, and AB Testing is
  preferable
• Experience as a Growth hacker and/or in Product analytics is a big plus

Why are we building Urbancomapny?

 

Organized service commerce is a large yet young industry in India. While India is a very large market for a home and local services (~USD 50 Billion in retail spends) and expected to double in the next 5 years, there is no billion-dollar company in this segment today.

 

The industry is bare ~20 years old, with a sub-optimal market architecture typical of an unorganized market - fragmented supply side operated by middlemen. As a result, experiences are broken for both customers and service professionals, each largely relying upon word of mouth to discover the other. The industry can easily be 1.5-2x larger than it is today if the frictions in user and professional's journeys are removed - and the experiences made more meaningful and joyful.

 

The Urban Company team is young and passionate, and we see a massive disruption opportunity in his industry. By leveraging technology, and a set of simple yet powerful processes, we wish to build a platform that can organize the world of services - and bring them to your finger-tips. We believe there is the immense value (akin to serendipity) in bringing together customers and professionals looking for each other. In the process, we hope to impact the lives of millions of service entrepreneurs, and transform service commerce they way Amazon transformed product commerce.

 

Job Description :

 

Urbancompany has grown 3x YOY and so as our tech stack. We have evolved in data-driven approach solving for the product over the last few years. We deal with around 10TB in data analytics with around 50Mn/day. We adopted platform thinking pretty at the very early stage of UC. We started building central platform teams who are dedicated solve for core engineering problems around 2-3 years ago and now it has evolved to a full-fledged vertical. Out platform vertical majorly includes Data Engineering, Service and Core Platform, Infrastructure, and Security. We are looking for an Engineering Manager for the Data Engineering team currently. A person who loves solving standardization, have strong platform thinking, opinions, have solved for Data Engineering, Data Science and analytics platform.

 

Job Responsibilities

 

• Building high octane teams with high opinions and strong platform thinking
• Working on complex design and architectural problems.
• Solving funnel analytics, product insights and building a highly scalable data platform
• Experience in building Data Science Platform 
• Highly productive data-driven models to contribute to product success and building
• Visioning out the roadmap and thought process behind taking current tech stack to next level
• Building and maintaining the high NPS of 70% of platform products
• Strong decision-maker with hands-on experience
• Think about abstractions, systems and services and write high-quality code.
• Have an understanding of loopholes in current systems/architecture that can potentially break in the future and push towards solving them with other stakeholders.
• Think through complex architecture to build robust platforms to serve together all the categories and flows, solve for scale, and work on internally build services to cater to our growing needs.

 

Job Requirements

 

• At least 1-2+ Years of experience in managing teams
• 5-8 years of experience in the industry solving complex problems from scratch and have graduate/post-graduate degrees from top-tier universities.
• A thinker with strong opinions and the ability to get those opinions into reality
• Prior experience of creating complex systems in the past.
• Ability to build scalable, sustainable, reliable, and secure products based on past experience and leading teams and projects by themselves.
• Ability to bring new practices, architectural choices, and new initiatives onto the table to make the overall tech stack more robust.
• History and familiarity with server-side architecture based on APIs, databases, infrastructure, and systems.
• Ability to own the technical road map for systems/components.

 

What can you expect?

 

• A phenomenal work environment, with massive ownership and growth opportunities.
• A high performance, high-velocity environment at the cutting edge of growth.
• Strong ownership expectation and freedom to fail.
• Quick iterations and deployments – fail-fast attitude.
• Opportunity to work on cutting edge technologies.
• The massive, and direct impact of the work you do on the lives of people.

Roles and Responsibilities:

• Responsible for developing and maintaining applications with PySpark 

About the Company, Conviva:
Conviva is the leader in streaming media intelligence, powered by its real-time platform. More than 250 industry leaders and brands – including CBS, CCTV, Cirque Du Soleil, DAZN, Disney+, HBO, Hulu, Sky, Sling TV, TED, Univision, and Warner Media – rely on Conviva to maximize their consumer engagement, deliver the quality experiences viewers expect and drive revenue growth. With a global footprint of more than 500 million unique viewers watching 150 billion streams per year across 3 billion applications streaming on devices, Conviva offers streaming providers unmatched scale for continuous video measurement, intelligence and benchmarking across every stream, every screen, every second. Conviva is privately held and headquartered in Silicon Valley, California, with offices around the world. For more information, please visit us at www.conviva.com.

What you get to do:
 Be a thought leader. As one of the senior most technical minds in the India centre, influence our technical evolution journey by pushing the boundaries of possibilities by testing forwarding looking ideas and demonstrating its value.
 Be a technical leader: Demonstrate pragmatic skills of translating requirements into technical design.
 Be an influencer. Understand challenges and collaborate across executives and stakeholders in a geographically distributed environment to influence them.
 Be a technical mentor. Build respect within team. Mentor senior engineers technically and
contribute to the growth of talent in the India centre.
 Be a customer advocate. Be empathetic to customer and domain by resolving ambiguity efficiently with the customer in mind.
 Be a transformation agent. Passionately champion engineering best practices and sharing across teams.
 Be hands-on. Participate regularly in code and design reviews, drive technical prototypes and actively contribute to resolving difficult production issues.

What you bring to the role:
 Thrive in a start-up environment and has a platform mindset.
 Excellent communicator. Demonstrated ability to succinctly communicate and describe complexvtechnical designs and technology choices both to executives and developers.
 Expert in Scala coding. JVM based stack is a bonus.
 Expert in big data technologies like Druid, Spark, Hadoop, Flink (or Akka) & Kafka.
 Passionate about one or more engineering best practices that influence design, quality of code or developer efficiency.
 Familiar with building distributed applications using webservices and RESTful APIs.
 Familiarity in building SaaS platforms on either in-house data centres or public cloud providers.

THE ROLE OF ANALYTICS IN INBOUND MARKETING In short, analytics can make or break inbound marketing. Analytics plays a critical role in guiding inbound marketing consultants towards delivering success for their clients. If things are not working well, analytics can find the solution. If things are working just OK, analytics can fire things up. Analytics can create the much needed impact to help Inbound Mantra clients grow. It is like being the centre forward in a football team. The web analytics specialist will work closely with fellow inbound marketing consulants to deliver on overall traffic goals, qualified lead numbers and campaign goals. This will require work across many functions of web analytics like set-up, monitoring, reporting, experimentation and continuous improvement including automation. It will also entail revisiting criteria to qualify traffic in terms of business and also hygiene factors such as bot activity, bounce rates and inaccurate tracking. DESIRED CANDIDATE Bachelor’s degree in Computer Science or equivalent experience 3 years of web analytics and reporting experience Should know Google Analytics inside out. Knowledge of Adobe analytics, Heap, Piwik would be good too Data visualization expert with proven body of work in Tableau / Google Data Studio Strong communication and presentation skills. Ability to say more with data. Ability to clearly communicate ideas and results to common people Strong analytic and technical thought process with the zeal to identify new analysis areas and opportunities for improvement Strong Data analysis skills with ability to work on large data sets, identify data anomalies, interpret findings, identify trends and generate insights Strong knowledge of current best practices and is always on the cutting-edge of all things analytics Familiarity with web development technologies to collect data points e.g. Data Layer AB tests and multivariate tests SEO and corresponding analytics James Bond of spreadsheets. Plus good SQL skills In depth working experience with Google Tag Manager JOB DESCRIPTION This is a CORE role at Inbound Mantra. You will have the following opportunity:- Implement and update code for collecting and reporting on web activity Analyze inbound marketing campaigns, give feedback to client delivery teams and follow through on their implementation Analyze user behavior – patterns, trends and predict, the impact of changes Identify content opportunities to drive traffic and leads Quickly respond to ad-hoc analytic requests. Design and maintain adhoc report and analyses Develop web analytics dashboards Analyze data from distributed sources and prepare insightful reports based on the findings Provide training to inbound marketing colleagues Recommend new tools and drive agile projects to implement them Drive thought-leadership on web analytics to position Inbound Mantra as a leading analytics focused inbound marketing agency. Be the subject matter expert for internal teams and the community Recruit new budding analytics talent and coach them Lead SEO analytics and drive 100% automation for it Design, develop and execute multi-variate tests Team up with HubSpot teams to create new analytics dashboard WHY YOU SHOULD CONSIDER INBOUND MANTRA? Inbound Mantra is a leader in Inbound Marketing based in Gurgaon, Delhi NCR (India). It is the only ‘Tiered’ HubSpot India partner. With clients in India and the US, Inbound Mantra is demonstrating leadership in this high-growth emerging area. If you are keen to get an early start in an emerging field, this opportunity is for you. A 3 to 5 year experience in this field, will put you at par with a (conventional) business and marketing professional with 10 years experience. Actually, senior marketing professionals (the incumbents) stand little chance, if they do not change. And that is the opportunity for you. Because, you don’t have to change. You were born (well almost) in a digital environment. HOW TO APPLY? Kindly send us a link of your “Public LinkedIn Profile” to raj along with your updated Resume. A short paragraph on why you are a right fit for this role would be wonderful. Please email with the Subject Line – ‘Web Analytics Specialist | {Your Name }’.

Data Scientist : Pluto7 is a services and solutions company focused on building ML, Ai, Analytics, and IoT tailored solutions to accelerate business transformation.We are a Premier Google Cloud Partner, servicing Retail, Manufacturing, Healthcare, and Hi-Tech industries. We are a Google premium partner in AI & ML, which means you'll have the opportunity to work and collaborate with folks from Google. Are you an innovator, have a passion to work with data and find insights, have the inquisitive mind with the constant yearning to learn new ideas; then we are looking for you.As a Pluto7 Data Scientist engineer, you will be one of the key members of our innovative artificial intelligence and machine learning team. You are expected to be unfazed with large volumes of data, love to apply various models, use technology to process and filter data for analysis. Responsibilities: Build and Optimize Machine Learning models. Work with large/complex datasets to solve difficult and non-routine analysis problems, applying advanced analytical methods as needed. Build and prototype data pipelines for analysis at scale. Work cross-functionally with Business Analysts and Data Engineers to help develop cutting edge and innovative artificial intelligence and machine learning models. Make recommendations for selections on machine learning models. Drive accuracy levels to the next stage of the given ML models. Experience in developing visualisation and User Good exposure in exploratory data analysis Strong experience in Statistics and ML algorithms. Minimum qualifications: 2+ years of relevant work experience in ML and advanced data analytics(e.g., as a Machine Learning Specialist / Data scientist ). Strong Experience using machine learning and artificial intelligence frameworks such as Tensorflow, sci-kit learn, Keras using python. Good in Python/R/SAS programming. Understanding of Cloud platforms like GCP, AWS, or other. Preferred qualifications: Work experience in building data pipelines to ingest, cleanse and transform data. Applied experience with machine learning on large datasets and experience translating analysis results into business recommendations. Demonstrated skills in selecting the right statistical tools given a data analysis problem. Demonstrated effective written and verbal communication skills. Demonstrated willingness to both teach others and learn new techniques Work location : Bangalore

Hi Candidates, Greetings From Publicvibe !!! We are Hiring NLP Engineers/ Data scientists in between 0.6 to 2.5 Years of Experience for our Hyderabad location, if anyone looking out for opportunities or Job change, reach out to us. Regards, Dhaneesha Dominic.