Data Engineer

RESPONSIBILITIES:

 Requirement understanding and elicitation, analyze, data/workflows, contribute to product

project and Proof of concept (POC)

 Contribute to prepare design documents and effort estimations.

 Develop AI/ML Models using best in-class ML models.

 Building, testing, and deploying AI/ML solutions.

 Work with Business Analysts and Product Managers to assist with defining functional user

stories.

 Ensure deliverables across teams are of high quality and clearly documented. 

 Recommend best ML practices/Industry standards for any ML use case.

 Proactively take up R and D and recommend solution options for any ML use case.

REQUIREMENTS:

Required Skills

 Overall experience of 4 to 7 Years working on AI/ML framework development

 Good programming knowledge in Python is must.

 Good Knowledge of R and SAS is desired.

 Good hands on and working knowledge SQL, Data Model, CRISP-DM.

 Proficiency with Uni/multivariate statistics, algorithm design, and predictive AI/ML modelling.

 Strong knowledge of machine learning algorithms, linear regression, logistic regression, KNN,

Random Forest, Support Vector Machines and Natural Language Processing.

 Experience with NLP and deep neural networks using synthetic and artificial data.

 Involved in different phases of SDLC and have good working exposure on different SLDC’s like

Agile Methodologies.

Job Description: Data Scientist

At Propellor.ai, we derive insights that allow our clients to make scientific decisions. We believe in demanding more from the fields of Mathematics, Computer Science, and Business Logic. Combine these and we show our clients a 360-degree view of their business. In this role, the Data Scientist will be expected to work on Procurement problems along with a team-based across the globe.

We are a Remote-First Company.

Read more about us here: https://www.propellor.ai/consulting" target="_blank">https://www.propellor.ai/consulting

What will help you be successful in this role

• Articulate
• High Energy
• Passion to learn
• High sense of ownership
• Ability to work in a fast-paced and deadline-driven environment
• Loves technology
• Highly skilled at Data Interpretation
• Problem solver
• Ability to narrate the story to the business stakeholders
• Generate insights and the ability to turn them into actions and decisions

Skills to work in a challenging, complex project environment

• Need you to be naturally curious and have a passion for understanding consumer behavior
• A high level of motivation, passion, and high sense of ownership
• Excellent communication skills needed to manage an incredibly diverse slate of work, clients, and team personalities
• Flexibility to work on multiple projects and deadline-driven fast-paced environment
• Ability to work in ambiguity and manage the chaos

Key Responsibilities

• Analyze data to unlock insights: Ability to identify relevant insights and actions from data.  Use regression, cluster analysis, time series, etc. to explore relationships and trends in response to stakeholder questions and business challenges.   
• Bring in experience for AI and ML:  Bring in Industry experience and apply the same to build efficient and optimal Machine Learning solutions.
• Exploratory Data Analysis (EDA) and Generate Insights: Analyse internal and external datasets using analytical techniques, tools, and visualization methods. Ensure pre-processing/cleansing of data and evaluate data points across the enterprise landscape and/or external data points that can be leveraged in machine learning models to generate insights. 
• DS and ML Model Identification and Training: Identity, test, and train machine learning models that need to be leveraged for business use cases. Evaluate models based on interpretability, performance, and accuracy as required. Experiment and identify features from datasets that will help influence model outputs.  Determine what models will need to be deployed, data points that need to be fed into models, and aid in the deployment and maintenance of models.

Technical Skills

An enthusiastic individual with the following skills. Please do not hesitate to apply if you do not match all of them. We are open to promising candidates who are passionate about their work, fast learners and are team players.

• Strong experience with machine learning and AI including regression, forecasting, time series, cluster analysis, classification, Image recognition, NLP, Text Analytics and Computer Vision.
• Strong experience with advanced analytics tools for Object-oriented/object function scripting using languages such as Python, or similar.
• Strong experience with popular database programming languages including SQL.
• Strong experience in Spark/Pyspark
• Experience in working in Databricks

What are the company benefits you get, when you join us as?

• Permanent Work from Home Opportunity
• Opportunity to work with Business Decision Makers and an internationally based team
• The work environment that offers limitless learning
• A culture void of any bureaucracy, hierarchy
• A culture of being open, direct, and with mutual respect
• A fun, high-caliber team that trusts you and provides the support and mentorship to help you grow
• The opportunity to work on high-impact business problems that are already defining the future of Marketing and improving real lives

To know more about how we work: https://bit.ly/3Oy6WlE" target="_blank">https://bit.ly/3Oy6WlE

Whom will you work with?

You will closely work with other Senior Data Scientists and Data Engineers.

Immediate to 15-day Joiners will be preferred.

• Responsibilities
       - Responsible for implementation and ongoing administration of Hadoop
  infrastructure.
       - Aligning with the systems engineering team to propose and deploy new
  hardware and software environments required for Hadoop and to expand existing
  environments.
       - Working with data delivery teams to setup new Hadoop users. This job includes
  setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig
  and MapReduce access for the new users.
       - Cluster maintenance as well as creation and removal of nodes using tools like
  Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and other tools
       - Performance tuning of Hadoop clusters and Hadoop MapReduce routines
       - Screen Hadoop cluster job performances and capacity planning
       - Monitor Hadoop cluster connectivity and security
       - Manage and review Hadoop log files.
       - File system management and monitoring.
       - Diligently teaming with the infrastructure, network, database, application and
  business intelligence teams to guarantee high data quality and availability
       - Collaboration with application teams to install operating system and Hadoop
  updates, patches, version upgrades when required.
      
  READ MORE OF THE JOB DESCRIPTION 
  Qualifications
  Qualifications
       - Bachelors Degree in Information Technology, Computer Science or other
  relevant fields
       - General operational expertise such as good troubleshooting skills,
  understanding of systems capacity, bottlenecks, basics of memory, CPU, OS,
  storage, and networks.
       - Hadoop skills like HBase, Hive, Pig, Mahout
       - Ability to deploy Hadoop cluster, add and remove nodes, keep track of jobs,
  monitor critical parts of the cluster, configure name node high availability, schedule
  and configure it and take backups.
       - Good knowledge of Linux as Hadoop runs on Linux.
       - Familiarity with open source configuration management and deployment tools
  such as Puppet or Chef and Linux scripting.
       Nice to Have
       - Knowledge of Troubleshooting Core Java Applications is a plus.

• We are looking for a Data Engineer to build the next-generation mobile applications for our world-class fintech product.
• The candidate will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross-functional teams.
• The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimising data systems and building them from the ground up.
• Looking for a person with a strong ability to analyse and provide valuable insights to the product and business team to solve daily business problems.
• You should be able to work in a high-volume environment, have outstanding planning and organisational skills.

Qualifications for Data Engineer

• Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimising ‘big data’ data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Looking for a candidate with 2-3 years of experience in a Data Engineer role, who is a CS graduate or has an equivalent experience.

What we're looking for?

• Experience with big data tools: Hadoop, Spark, Kafka and other alternate tools.
• Experience with relational SQL and NoSQL databases, including MySql/Postgres and Mongodb.
• Experience with data pipeline and workflow management tools: Luigi, Airflow.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
• Experience with stream-processing systems: Storm, Spark-Streaming.
• Experience with object-oriented/object function scripting languages: Python, Java, Scala.

• B.Tech/MTech from tier 1 institution
• 8+years of experience in machine learning techniques like logistic regression, random forest, boosting, trees, neural networks, etc.
• Showcased experience with Python, SQL and proficiency in Scikit Learn, Pandas, NumPy, Keras and TensorFlow/pytorch
• Experience of working with Qlik sense or Tableau is a plus