Big Data Engineer

Job Title

Data Analyst

Job Brief

The successful candidate will turn data into information, information into insight and insight into business decisions.

Data Analyst Job Duties

Data analyst responsibilities include conducting full lifecycle analysis to include requirements, activities and design. Data analysts will develop analysis and reporting capabilities. They will also monitor performance and quality control plans to identify improvements.

Responsibilities

● Interpret data, analyze results using statistical techniques and provide ongoing reports.

● Develop and implement databases, data collection systems, data analytics and other strategies that optimize statistical efficiency and quality.

● Acquire data fromprimary orsecondary data sources andmaintain databases/data systems.

● Identify, analyze, and interpret trends orpatternsin complex data sets.

● Filter and “clean” data by reviewing computerreports, printouts, and performance indicatorsto locate and correct code problems.

● Work withmanagementto prioritize business and information needs.

● Locate and define new processimprovement opportunities. 

Requirements

● Proven working experienceas aData Analyst or BusinessDataAnalyst.

● Technical expertise regarding data models, database design development, data mining and segmentation techniques.

● Strong knowledge of and experience with reporting packages (Business Objects etc), databases (SQL etc), programming (XML, Javascript, or ETL frameworks).

● Knowledge of statistics and experience using statistical packages for analyzing datasets (Excel, SPSS, SAS etc).

● Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.

● Adept atqueries,reportwriting and presenting findings.

Job Location SouthDelhi, New Delhi 

Sizzle is an exciting new startup that’s changing the world of gaming.  At Sizzle, we’re building AI to automate gaming highlights, directly from Twitch and YouTube streams. We’re looking for a superstar engineer that is well versed with computer vision and AI technologies around image and video analysis.  

You will be responsible for:

• Developing computer vision algorithms to detect key moments within popular online games
• Leveraging baseline technologies such as TensorFlow, OpenCV, and others -- and building models on top of them
• Building neural network (CNN) architectures for image and video analysis, as it pertains to popular games
• Specifying exact requirements for training data sets, and working with analysts to create the data sets
• Training final models, including techniques such as transfer learning, data augmentation, etc. to optimize models for use in a production environment
• Working with back-end engineers to get all of the detection algorithms into production, to automate the highlight creation

You should have the following qualities:

• Solid understanding of computer vision and AI frameworks and algorithms, especially pertaining to image and video analysis
• Experience using Python, TensorFlow, OpenCV and other computer vision tools
• Understand common computer vision object detection models in use today e.g. Inception, R-CNN, Yolo, MobileNet SSD, etc.
• Demonstrated understanding of various algorithms for image and video analysis, such as CNNs, LSTM for motion and inter-frame analysis, and others
• Familiarity with AWS environments
• Excited about working in a fast-changing startup environment
• Willingness to learn rapidly on the job, try different things, and deliver results
• Ideally a gamer or someone interested in watching gaming content online

Skills:

Machine Learning, Computer Vision, Image Processing, Neural Networks, TensorFlow, OpenCV, AWS, Python

Seniority: We are open to junior or senior engineers. We're more interested in the proper skillsets.

Salary: Will be commensurate with experience. 

Who Should Apply:

If you have the right experience, regardless of your seniority, please apply. However, if you don't have AI or computer vision experience, please do not apply.

Job Responsibilities

• Design, build & test ETL processes using Python & SQL for the corporate data warehouse
• Inform, influence, support, and execute our product decisions
• Maintain advertising data integrity by working closely with R&D to organize and store data in a format that provides accurate data and allows the business to quickly identify issues.
• Evaluate and prototype new technologies in the area of data processing
• Think quickly, communicate clearly and work collaboratively with product, data, engineering, QA and operations teams
• High energy level, strong team player and good work ethic
• Data analysis, understanding of business requirements and translation into logical pipelines & processes
• Identification, analysis & resolution of production & development bugs
• Support the release process including completing & reviewing documentation
• Configure data mappings & transformations to orchestrate data integration & validation
• Provide subject matter expertise
• Document solutions, tools & processes
• Create & support test plans with hands-on testing
• Peer reviews of work developed by other data engineers within the team
• Establish good working relationships & communication channels with relevant departments

Skills and Qualifications we look for

• University degree 2.1 or higher (or equivalent) in a relevant subject. Master’s degree in any data subject will be a strong advantage.
• 4 - 6 years experience with data engineering.
• Strong coding ability and software development experience in Python.
• Strong hands-on experience with SQL and Data Processing.
• Google cloud platform (Cloud composer, Dataflow, Cloud function, Bigquery, Cloud storage, dataproc)
• Good working experience in any one of the ETL tools (Airflow would be preferable).
• Should possess strong analytical and problem solving skills.
• Good to have skills - Apache pyspark, CircleCI, Terraform
• Motivated, self-directed, able to work with ambiguity and interested in emerging technologies, agile and collaborative processes.
• Understanding & experience of agile / scrum delivery methodology

We are looking for an exceptionally talented Lead data engineer who has exposure in implementing AWS services to build data pipelines, api integration and designing data warehouse. Candidate with both hands-on and leadership capabilities will be ideal for this position.

Qualification: At least a bachelor’s degree in Science, Engineering, Applied Mathematics. Preferred Masters degree

Job Responsibilities:

• Total 6+ years of experience as a Data Engineer and 2+ years of experience in managing a team

• Have minimum 3 years of AWS Cloud experience.

• Well versed in languages such as Python, PySpark, SQL, NodeJS etc

• Has extensive experience in Spark ecosystem and has worked on both real time and batch processing

• Have experience in AWS Glue, EMR, DMS, Lambda, S3, DynamoDB, Step functions, Airflow, RDS, Aurora etc.

• Experience with modern Database systems such as Redshift, Presto, Hive etc.

• Worked on building data lakes in the past on S3 or Apache Hudi

• Solid understanding of Data Warehousing Concepts

• Good to have experience on tools such as Kafka or Kinesis

• Good to have AWS Developer Associate or Solutions Architect Associate Certification

• Have experience in managing a team

About Kloud9:

Kloud9 exists with the sole purpose of providing cloud expertise to the retail industry. Our team of cloud architects, engineers and developers help retailers launch a successful cloud initiative so you can quickly realise the benefits of cloud technology. Our standardised, proven cloud adoption methodologies reduce the cloud adoption time and effort so you can directly benefit from lower migration costs.

Kloud9 was founded with the vision of bridging the gap between E-commerce and cloud. The E-commerce of any industry is limiting and poses a huge challenge in terms of the finances spent on physical data structures.

At Kloud9, we know migrating to the cloud is the single most significant technology shift your company faces today. We are your trusted advisors in transformation and are determined to build a deep partnership along the way. Our cloud and retail experts will ease your transition to the cloud.

Our sole focus is to provide cloud expertise to retail industry giving our clients the empowerment that will take their business to the next level. Our team of proficient architects, engineers and developers have been designing, building and implementing solutions for retailers for an average of more than 20 years.

We are a cloud vendor that is both platform and technology independent. Our vendor independence not just provides us with a unique perspective into the cloud market but also ensures that we deliver the cloud solutions available that best meet our clients' requirements.

●    Overall 8+ Years of Experience in Web Application development.

●    5+ Years of development experience with JAVA8 , Springboot, Microservices and middleware

●    3+ Years of Designing Middleware using Node JS platform.

●    good to have 2+ Years of Experience in using NodeJS along with AWS Serverless platform.

●    Good Experience with Javascript / TypeScript, Event Loops, ExpressJS, GraphQL, SQL DB (MySQLDB), NoSQL DB(MongoDB) and YAML templates.

●    Good Experience with TDD Driven Development and Automated Unit Testing.

●    Good Experience with exposing and consuming Rest APIs in Java 8, Springboot platform and Swagger API contracts.

●    Good Experience in building NodeJS middleware performing Transformations, Routing, Aggregation, Orchestration and Authentication(JWT/OAUTH).

●    Experience supporting and working with cross-functional teams in a dynamic environment.

●    Experience working in Agile Scrum Methodology.

●    Very good Problem-Solving Skills.

●    Very good learner and passion for technology.

●     Excellent verbal and written communication skills in English

●     Ability to communicate effectively with team members and business stakeholders

Secondary Skill Requirements:

● Experience working with any of Loopback, NestJS, Hapi.JS, Sails.JS, Passport.JS

Why Explore a Career at Kloud9:

With job opportunities in prime locations of US, London, Poland and Bengaluru, we help build your career paths in cutting edge technologies of AI, Machine Learning and Data Science. Be part of an inclusive and diverse workforce that's changing the face of retail technology with their creativity and innovative solutions. Our vested interest in our employees translates to deliver the best products and solutions to our customers.

Responsibilities

• Build and mentor the computer vision team at TransPacks
• Drive to productionize algorithms (industrial level) developed through hard-core research
• Own the design, development, testing, deployment, and craftsmanship of the team’s infrastructure and systems capable of handling massive amounts of requests with high reliability and scalability
• Leverage the deep and broad technical expertise to mentor engineers and provide leadership on resolving complex technology issues
• Entrepreneurial and out-of-box thinking essential for a technology startup
• Guide the team for unit-test code for robustness, including edge cases, usability, and general reliability

Eligibility

• Tech in Computer Science and Engineering/Electronics/Electrical Engineering, with demonstrated interest in Image Processing/Computer vision (courses, projects etc) and 6-8 years of experience
• Tech in Computer Science and Engineering/Electronics/Electrical Engineering, with demonstrated interest in Image Processing/Computer vision (Thesis work) and 4-7 years of experience
• D in Computer Science and Engineering/Electronics/Electrical Engineering, with demonstrated interest in Image Processing/Computer vision (Ph. D. Dissertation) and inclination to working in Industry to provide innovative solutions to practical problems

Requirements

• In-depth understanding of image processing algorithms, pattern recognition methods, and rule-based classifiers
• Experience in feature extraction, object recognition and tracking, image registration, noise reduction, image calibration, and correction
• Ability to understand, optimize and debug imaging algorithms
• Understating and experience in openCV library
• Fundamental understanding of mathematical techniques involved in ML and DL schemas (Instance-based methods, Boosting methods, PGM, Neural Networks etc.)
• Thorough understanding of state-of-the-art DL concepts (Sequence modeling, Attention, Convolution etc.) along with knack to imagine new schemas that work for the given data.
• Understanding of engineering principles and a clear understanding of data structures and algorithms
• Experience in writing production level codes using either C++ or Java
• Experience with technologies/libraries such as python pandas, numpy, scipy
• Experience with tensorflow and scikit.

High Level Scope of Work :

• Work with AI / Analytics team to priorities MACHINE LEARNING Identified USE CASES for Development and Rollout
• Meet and understand current retail / Marketing Requirements and how AI/ML solution will address and automate the decision process.
• Develop AI/ML Programs using DATAIKU Solution & Python or open source tech with focus to deliver high Quality and accurate ML prediction Model
• Gather additional and external data sources to support the AI/ML Model as desired .
• Support the ML Model and FINE TUNEit to ensure high accuracy all the time.
• Example of use cases (Customer Segmentation , Product Recommendation, Price Optimization, Retail Customer Personalization Offers, Next Best Location for Business Est, CCTV Computer Vision, NLP and Voice Recognition Solutions)

Required technology expertise :

• Deep Knowledge & Understanding on MACHINE LEARNING ALGORITHMS (Supervised / Unsupervised Learning / Deep Learning Models)
• Hands on EXP for at least 5+ years with PYTHON and R STATISTICS PROGRAMMING Languages
• Strong Database Development knowledge using SQL and PL/SQL
• Must have EXP using Commercial Data Science Solution particularly DATAIKU and (Altryx, SAS, Azure ML, Google ML, Oracle ML is a plus)
• Strong hands on EXP with BIG DATA Solution Architecture and Optimization for AI/ML Workload.
• Data Analytics and BI Tools Hand on EXP particularly (Oracle OBIEE and Power BI)
• Have implemented and Developed at least 3 successful AI/ML Projects with tangible Business Outcomes In retail Focused Industry
• Have at least 5+ Years EXP in Retail Industry and Customer Focus Business.
• Ability to communicate with Business Owner & stakeholders to understand their current issues and provide MACHINE LEARNING Solution accordingly.

Qualifications

• Bachelor Degree or Master Degree in Data Science, Artificial Intelligent, Computer Science
• Certified as DATA SCIENTIST or MACHINE LEARNING Expert.

What you will be doing:

As a part of the Global Credit Risk and Data Analytics team, this person will be responsible for carrying out analytical initiatives which will be as follows: -

• Dive into the data and identify patterns
• Development of end-to-end Credit models and credit policy for our existing credit products
• Leverage alternate data to develop best-in-class underwriting models
• Working on Big Data to develop risk analytical solutions
• Development of Fraud models and fraud rule engine
• Collaborate with various stakeholders (e.g. tech, product) to understand and design best solutions which can be implemented
• Working on cutting-edge techniques e.g. machine learning and deep learning models

Example of projects done in past:

• Lazypay Credit Risk model using CatBoost modelling technique ; end-to-end pipeline for feature engineering and model deployment in production using Python
• Fraud model development, deployment and rules for EMEA region

Basic Requirements:

• 1-3 years of work experience as a Data scientist (in Credit domain)
• 2016 or 2017 batch from a premium college (e.g B.Tech. from IITs, NITs, Economics from DSE/ISI etc)
• Strong problem solving and understand and execute complex analysis
• Experience in at least one of the languages - R/Python/SAS and SQL
• Experience in in Credit industry (Fintech/bank)
• Familiarity with the best practices of Data Science

Add-on Skills : 

• Experience in working with big data
• Solid coding practices
• Passion for building new tools/algorithms
• Experience in developing Machine Learning models