Senior Big Data Engineer

About antuit.ai

Antuit.ai is the leader in AI-powered SaaS solutions for Demand Forecasting & Planning, Merchandising and Pricing. We have the industry’s first solution portfolio – powered by Artificial Intelligence and Machine Learning – that can help you digitally transform your Forecasting, Assortment, Pricing, and Personalization solutions. World-class retailers and consumer goods manufacturers leverage antuit.ai solutions, at scale, to drive outsized business results globally with higher sales, margin and sell-through.

Antuit.ai’s executives, comprised of industry leaders from McKinsey, Accenture, IBM, and SAS, and our team of Ph.Ds., data scientists, technologists, and domain experts, are passionate about delivering real value to our clients. Antuit.ai is funded by Goldman Sachs and Zodius Capital.

The Role:

Antuit is looking for a Data / Sr. Data Scientist who has the knowledge and experience in developing machine learning algorithms, particularly in supply chain and forecasting domain with data science toolkits like Python.

In this role, you will design the approach, develop and test machine learning algorithms, implement the solution.  The candidate should have excellent communication skills and be results driven with a customer centric approach to problem solving.  Experience working in the demand forecasting or supply chain domain is a plus. This job also requires the ability to operate in a multi-geographic delivery environment and a good understanding of cross-cultural sensitivities.

Responsibilities:

Responsibilities includes, but are not limited to the following:

• Design, build, test, and implement predictive Machine Learning models.
• Collaborate with client to align business requirements with data science systems and process solutions that ensure client’s overall objectives are met.
• Create meaningful presentations and analysis that tell a “story” focused on insights, to communicate the results/ideas to key decision makers.
• Collaborate cross-functionally with domain experts to identify gaps and structural problems.
• Contribute to standard business processes and practices as part of a community of practise.
• Be the subject matter expert across multiple work streams and clients.
• Mentor and coach team members.
• Set a clear vision for the team members and working cohesively to attain it.

Qualifications and Skills:

Requirements

• Experience / Education:
  • Master’s or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, Statistics, Applied Mathematics or other related 
• 5+ years’ experience working in applied machine learning or relevant research experience for recent Ph.D. graduates.
• Highly technical:
• Skilled in machine learning, problem-solving, pattern recognition and predictive modeling with expertise in PySpark and Python.
• Understanding of data structures and data modeling.
• Effective communication and presentation skills
• Able to collaborate closely and effectively with teams.
• Experience in time series forecasting is preferred.
• Experience working in start-up type environment preferred.
• Experience in CPG and/or Retail preferred.
• Effective communication and presentation skills.
• Strong management track record.
• Strong inter-personal skills and leadership qualities.

Information Security Responsibilities

• Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
• Take part in Information Security training and act accordingly while handling information.
• Report all suspected security and policy breach to Infosec team or appropriate authority (CISO).

EEOC

TOP 3 SKILLS

Python (Language)

Spark Framework

Spark Streaming

Docker/Jenkins/ Spinakar

AWS

Hive Queries

He/She should be good coder.

Preff: - Airflow

Must have experience: -

Python

Spark framework and streaming

exposure to Machine Learning Lifecycle is mandatory.

Project:

This is searching domain project. Any searching activity which is happening on website this team create the model for the same, they create sorting/scored model for any search. This is done by the data

scientist This team is working more on the streaming side of data, the candidate would work extensively on Spark streaming and there will be a lot of work in Machine Learning.

INTERVIEW INFORMATION

3-4 rounds.

1st round based on data engineering batching experience.

2nd round based on data engineering streaming experience.

3rd round based on ML lifecycle (3rd round can be a techno-functional round based on previous

feedbacks otherwise 4th round will be a functional round if required.

Company Profile :

Merilytics, an Accordion company is a fast-growing analytics firm offering advanced a and intelligent analytical solutions to clients globally. We combine domain expertise, advanced analytics, and technology to provide robust solutions for clients' business problems. You can find further details about the company at https://merilytics.com.

We partner with our clients in Private Equity, CPG, Retail, Healthcare, Media & Entertainment, Technology, Logistics industries etc. by providing analytical solutions to generate superior returns. We solve clients' business problems by analyzing large amount of data to help guide their Operations, Marketing, Pricing, Customer Strategies, and much more.

Position :

- Business Associate at Merilytics will be working on complex analytical projects and is the primary owner of the work streams involved.

- The Business Associates are expected to lead the team of Business Analysts to deliver robust analytical solutions consistently and mentor the Analysts for professional development.

Location : Hyderabad

Roles and Responsibilities :

The roles and responsibilities of a Business Associate will include the below:

- Proactively provide thought leadership to the team and have complete control on the delivery process of the project.

- Understand the client's point of view and translate it into sound judgment calls in ambiguous analytical situations.

- Highlight potential analytical issues upfront and resolve them independently.

- Synthesizes the analysis and derives insights independently.

- Identify the crux of the client problem and leverage it to draw relevant actionable insights from the analysis/work.

- Ability to manage multiple Analysts and provide customized guidance for individual development.

- Resonate with our five core values - Client First, Excellence, Integrity, Respect and Teamwork.

Pre-requisites and skillsets required to apply for this role :

- Undergraduate degree (B.E/B.Tech.) from tier-1/tier-2 colleges are preferred.

- Should have 2-4 years of experience.

- Strong leadership & proactive communication to coordinate with the project team and other internal stakeholders.

- Ability to use business judgement and a structured approach towards solving complex problems.

- Experience in client-facing/professional services environment is a plus.

- Strong hard skills on analytics tools such as R, Python, SQL, and Excel is a plus.

Why Explore a Career at Merilytics :

- High growth environment: Semi-annual performance management and promotion cycles coupled with a strong meritocratic culture, enables fast track to leadership responsibility.

- Cross Domain Exposure: Interesting and challenging work streams across industries and domains that always keep you excited, motivated, and on your toes.

- Entrepreneurial Environment: Intellectual freedom to make decisions and own them. We expect you to spread your wings and assume larger responsibilities.

- Fun culture and peer group: Non-bureaucratic and fun working environment; Strong peer environment that will challenge you and accelerate your learning curve.

Other benefits for full time employees:

(i) Health and wellness programs that include employee health insurance covering immediate family members and parents, term life insurance for employees, free health camps for employees, discounted health services (including vision, dental) for employee and family members, free doctor's consultations, counselors, etc.

(ii) Corporate Meal card options for ease of use and tax benefits.

(iii) Work dinners, team lunches, company sponsored team outings and celebrations.

(iv) Reimbursement support for travel to the office, as and when promulgated by the Company.

(v) Cab reimbursement for women employees beyond a certain time of the day.

(vi) Robust leave policy to support work-life balance. Specially designed leave structure to support woman employees for maternity and related requests.

(vii) Reward and recognition platform to celebrate professional and personal milestones.

(viii) A positive & transparent work environment including various employee engagement and employee benefit initiatives to support personal and professional learning and development.

What are the Key Responsibilities:

• Design NLP applications
• Select appropriate annotated datasets for Supervised Learning methods
• Use effective text representations to transform natural language into useful features
• Find and implement the right algorithms and tools for NLP tasks
• Develop NLP systems according to requirements
• Train the developed model and run evaluation experiments
• Perform statistical analysis of results and refine models
• Extend ML libraries and frameworks to apply in NLP tasks
• Remain updated in the rapidly changing field of machine learning

What are we looking for:

• Proven experience as an NLP Engineer or similar role
• Understanding of NLP techniques for text representation, semantic extraction techniques, data structures, and modeling
• Ability to effectively design software architecture
• Deep understanding of text representation techniques (such as n-grams, a bag of words, sentiment analysis etc), statistics and classification algorithms
• Knowledge of Python, Java, and R
• Ability to write robust and testable code
• Experience with machine learning frameworks (like Keras or PyTorch) and libraries (like sci-kit-learn)
• Strong communication skills
• An analytical mind with problem-solving abilities
• Degree in Computer Science, Mathematics, Computational Linguistics, or similar field

Technical Knowledge (Must Have)

• Strong experience in SQL / HiveQL/ AWS Athena,
• Strong expertise in the development of data pipelines (snaplogic is preferred).
• Design, Development, Deployment and administration of data processing applications.
• Good Exposure towards AWS and Azure Cloud computing environments.
• Knowledge around BigData, AWS Cloud Architecture, Best practices, Securities, Governance, Metadata Management, Data Quality etc.
• Data extraction through various firm sources (RDBMS, Unstructured Data Sources) and load to datalake with all best practices.
• Knowledge in Python
• Good knowledge in NoSQL technologies (Neo4J/ MongoDB)
• Experience/knowledge in SnapLogic (ETL Technologies)
• Working knowledge on Unix (AIX, Linux), shell scripting
• Experience/knowledge in Data Modeling. Database Development
• Experience/knowledge creation of reports and dashboards in Tableau/ PowerBI

• 4-10 years of experience in software development.
• At least 2 years of relevant work experience on large scale Data applications.
• Strong coding experience in Java is mandatory
• Good aptitude, strong problem solving abilities, and analytical skills, ability to take ownership as appropriate
• Should be able to do coding, debugging, performance tuning and deploying the apps to Prod.
• Should have good working experience on
• o Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet)
• o Kafka
• o J2EE Frameworks (Spring/Hibernate/REST)
• o Spark Streaming or any other streaming technology.
• Strong coding experience in Java is mandatory
• Ability to work on the sprint stories to completion along with Unit test case coverage.
• Experience working in Agile Methodology
• Excellent communication and coordination skills
• Knowledgeable (and preferred hands on) - UNIX environments, different continuous integration tools.
• Must be able to integrate quickly into the team and work independently towards team goals

• Take the complete responsibility of the sprint stories' execution
• Be accountable for the delivery of the tasks in the defined timelines with good quality.
• Follow the processes for project execution and delivery.
• Follow agile methodology
• Work with the team lead closely and contribute to the smooth delivery of the project.
• Understand/define the architecture and discuss the pros-cons of the same with the team
• Involve in the brainstorming sessions and suggest improvements in the architecture/design.
• Work with other team leads to get the architecture/design reviewed.
• Work with the clients and counter-parts (in US) of the project.
• Keep all the stakeholders updated about the project/task status/risks/issues if there are any.