Senior Technical Consultant

• 3+ years of Experience majoring in applying AI/ML/ NLP / deep learning / data-driven statistical analysis & modelling solutions.
• Programming skills in Python, knowledge in Statistics.
• Hands-on experience developing supervised and unsupervised machine learning algorithms (regression, decision trees/random forest, neural networks, feature selection/reduction, clustering, parameter tuning, etc.). Familiarity with reinforcement learning is highly desirable.
• Experience in the financial domain and familiarity with financial models are highly desirable.
• Experience in image processing and computer vision.
• Experience working with building data pipelines.
• Good understanding of Data preparation, Model planning, Model training, Model validation, Model deployment and performance tuning.
• Should have hands on experience with some of these methods: Regression, Decision Trees,CART, Random Forest, Boosting, Evolutionary Programming, Neural Networks, Support Vector Machines, Ensemble Methods, Association Rules, Principal Component Analysis, Clustering, ArtificiAl Intelligence
• Should have experience in using larger data sets using Postgres Database. 

1. Create and maintain optimal data pipeline architecture
2. Assemble large, complex data sets that meet business requirements
3. Identifying, designing, and implementing internal process improvements including redesigning infrastructure for greater scalability, optimizing data delivery, and automating manual processes
4. Work with Data, Analytics & Tech team to extract, arrange and analyze data
5. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies
6. Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
7. Works closely with all business units and engineering teams to develop a strategy for long-term data platform architecture.
8. Working with stakeholders including data, design, product, and executive teams, and assisting them with data-related technical issues
9. Working with stakeholders including the Executive, Product, Data, and Design teams to support their data infrastructure needs while assisting with data-related technical issues.

1. SQL
2. Ruby or Python(Ruby preferred)
3. Apache-Hadoop based analytics
4. Data warehousing
5. Data architecture
6. Schema design
7. ML

1.  Prior experience of 2 to 5 years as a Data Engineer.
2. Ability in managing and communicating data warehouse plans to internal teams.
3. Experience designing, building, and maintaining data processing systems.
4. Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions.
5. Excellent analytic skills associated with working on unstructured datasets.
6. Ability to build processes that support data transformation, workload management, data structures, dependency, and metadata.

BRIEF DESCRIPTION:

At-least 1 year of Python, Spark, SQL, data engineering experience

Primary Skillset: PySpark, Scala/Python/Spark, Azure Synapse, S3, RedShift/Snowflake

Relevant Experience: Legacy ETL job Migration to AWS Glue / Python & Spark combination

ROLE SCOPE:

Reverse engineer the existing/legacy ETL jobs

Create the workflow diagrams and review the logic diagrams with Tech Leads

Write equivalent logic in Python & Spark

Unit test the Glue jobs and certify the data loads before passing to system testing

Follow the best practices, enable appropriate audit & control mechanism

Analytically skillful, identify the root causes quickly and efficiently debug issues

Take ownership of the deliverables and support the deployments

REQUIREMENTS:

Create data pipelines for data integration into Cloud stacks eg. Azure Synapse

Code data processing jobs in Azure Synapse Analytics, Python, and Spark

Experience in dealing with structured, semi-structured, and unstructured data in batch and real-time environments.

Should be able to process .json, .parquet and .avro files

PREFERRED BACKGROUND:

Tier1/2 candidates from IIT/NIT/IIITs

However, relevant experience, learning attitude takes precedence

Role : 

• Understand and translate statistics and analytics to address business problems
• Responsible for helping in data preparation and data pull, which is the first step in machine learning
• Should be able to do cut and slice data to extract interesting insights from the data
• Model development for better customer engagement and retention
• Hands on experience in relevant tools like SQL(expert), Excel, R/Python
• Working on strategy development to increase business revenue

Requirements:

• Hands on experience in relevant tools like SQL(expert), Excel, R/Python
• Statistics: Strong knowledge of statistics
• Should able to do data scraping & Data mining
• Be self-driven, and show ability to deliver on ambiguous projects
• An ability and interest in working in a fast-paced, ambiguous and rapidly-changing environment
• Should have worked on Business Projects for an organization, Ex: customer acquisition, Customer retention.

• 6+ years of recent hands-on Java development
• Developing data pipelines in AWS or Google Cloud
• Java, Python, JavaScript programming languages
• Great understanding of designing for performance, scalability, and reliability of data intensive application
• Hadoop MapReduce, Spark, Pig. Understanding of database fundamentals and advanced SQL knowledge.
• In-depth understanding of object oriented programming concepts and design patterns
• Ability to communicate clearly to technical and non-technical audiences, verbally and in writing
• Understanding of full software development life cycle, agile development and continuous integration
• Experience in Agile methodologies including Scrum and Kanban