Assistant Data Scientist

Job ID: ZS0701

Hi,

We are hiring for Data Scientist for Bangalore.

Req Skills:

• NLP 

• ML programming
• Spark
• Model Deployment
• Experience processing unstructured data and building NLP models
• Experience with big data tools pyspark
• Pipeline orchestration using Airflow and model deployment experience is preferred

• Core Java: advanced level competency, should have worked on projects with core Java development.

 

• Linux shell : advanced level competency, work experience with Linux shell scripting, knowledge and experience to use important shell commands

 

• Rdbms, SQL: advanced level competency, Should have expertise in SQL query language syntax, should be well versed with aggregations, joins of SQL query language.

 

• Data structures and problem solving: should have ability to use appropriate data structure.

 

• AWS cloud : Good to have experience with aws serverless toolset along with aws infra

 

• Data Engineering ecosystem : Good to have experience and knowledge of data engineering, ETL, data warehouse (any toolset)

 

• Hadoop, HDFS, YARN : Should have introduction to internal working of these toolsets

 

• HIVE, MapReduce, Spark: Good to have experience developing transformations using hive queries, MapReduce job implementation and Spark Job Implementation. Spark implementation in Scala will be plus point.

 

• Airflow, Oozie, Sqoop, Zookeeper, Kafka: Good to have knowledge about purpose and working of these technology toolsets. Working experience will be a plus point here.

 

InViz is Bangalore Based Startup helping Enterprises simplifying the Search and Discovery experiences for both their end customers as well as their internal users. We use state-of-the-art technologies in Computer Vision, Natural Language Processing, Text Mining, and other ML techniques to extract information/concepts from data of different formats- text, images, videos and make them easily discoverable through simple human-friendly touchpoints. 

 

TSDE - Data 

Data Engineer:

 

• Should have total 3-6 Yrs of experience in Data Engineering.
• Person should have experience in coding data pipeline on GCP. 
• Prior experience on Hadoop systems is ideal as candidate may not have total GCP experience. 
• Strong on programming languages like Scala, Python, Java. 
• Good understanding of various data storage formats and it’s advantages. 
• Should have exposure on GCP tools to develop end to end data pipeline for various scenarios (including ingesting data from traditional data bases as well as integration of API based data sources). 
• Should have Business mindset to understand data and how it will be used for BI and Analytics purposes. 
• Data Engineer Certification preferred 

 

Experience in Working with GCP tools like
	Store :  CloudSQL , Cloud Storage, Cloud Bigtable,  Bigquery, Cloud Spanner, Cloud DataStore
	Ingest :  Stackdriver, Pub/Sub, AppEngine, Kubernete Engine, Kafka, DataPrep , Micro services
	Schedule : Cloud Composer
	Processing: Cloud Dataproc, Cloud Dataflow, Cloud Dataprep
	CI/CD - Bitbucket+Jenkinjs / Gitlab
	Atlassian Suite

 

 .

You'll have the following skills & experience:

• Problem Solving:. Resolving production issues to fix service P1-4 issues. Problems relating to
introducing new technology, and resolving major issues in the platform and/or service.
• Software Development Concepts: Understands and is experienced with the use of a wide range of
programming concepts and is also aware of and has applied a range of algorithms.
• Commercial & Risk Awareness: Able to understand & evaluate both obvious and subtle commercial
risks, especially in relation to a programme.
Experience you would be expected to have
• Cloud: experience with one of the following cloud vendors: AWS, Azure or GCP
• GCP : Experience prefered, but learning essential.
• Big Data: Experience with Big Data methodology and technologies
• Programming : Python or Java worked with Data (ETL)
• DevOps: Understand how to work in a Dev Ops and agile way / Versioning / Automation / Defect
Management – Mandatory
• Agile methodology - knowledge of Jira

In this role, we are looking for:

• A problem-solving mindset with the ability to understand business challenges and how to apply your analytics expertise to solve them.
• The unique person who can present complex mathematical solutions in a simple manner that most will understand, using data visualization techniques to tell a story with data.
• An individual excited by innovation and new technology and eager to finds ways to employ these innovations in practice.
• A team mentality, empowered by the ability to work with a diverse set of individuals.
• A passion for data, with a particular emphasis on data visualization.

 

 

• A Bachelor’s degree in Data Science, Math, Statistics, Computer Science or related field with an emphasis on data analytics.
• 5+ Years professional experience, preferably in a data analyst / data scientist role or similar, with proven results in a data analyst role.
• 3+ Years professional experience in a leadership role guiding high-performing, data-focused teams with a track record of building and developing talent.
• Proficiency in your statistics / analytics / visualization tool of choice, but preferably in the Microsoft Azure Suite, including PowerBI and/or AzureML.

• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools: Experience with big
  • data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift
  • Experience with stream-processing systems: Storm, Spark-Streaming, etc.
  • Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.

• Research and develop statistical learning models for data analysis
• Collaborate with product management and engineering departments to understand company needs and devise possible solutions
• Keep up-to-date with latest technology trends
• Communicate results and ideas to key decision makers
• Implement new statistical or other mathematical methodologies as needed for specific models or analysis
• Optimize joint development efforts through appropriate database use and project design

Qualifications/Requirements:

• Masters or PhD in Computer Science, Electrical Engineering, Statistics, Applied Math or equivalent fields with strong mathematical background
• Excellent understanding of machine learning techniques and algorithms, including clustering, anomaly detection, optimization, neural network etc
• 3+ years experiences building data science-driven solutions including data collection, feature selection, model training, post-deployment validation
• Strong hands-on coding skills (preferably in Python) processing large-scale data set and developing machine learning models
• Familiar with one or more machine learning or statistical modeling tools such as Numpy, ScikitLearn, MLlib, Tensorflow
• Good team worker with excellent communication skills written, verbal and presentation

Desired Experience:

• Experience with AWS, S3, Flink, Spark, Kafka, Elastic Search
• Knowledge and experience with NLP technology
• Previous work in a start-up environment

We are cloud based company working on secureity projects.

Good Python developers / Data Engineers / Devops engineers
Exp: 1-8years
Work loc: Chennai. / Remote support