Data Engineer

Senior Executive - Analytics

Overview of job :-

Our Client is the world’s largest media investment company which is a part of WPP. They are a global digital transformation agency with 1200 employees across 21 nations. Our team of experts support clients in programmatic, social, paid search, analytics, technology, organic search, affiliate marketing, e-commerce and across traditional channels.

We are currently looking for a Sr Executive – Analytics to join us. In this role, you will be responsible for a massive opportunity to build and be a part of largest performance marketing setup APAC is committed to fostering a culture of diversity and inclusion. Our people are our strength so we respect and nurture their individual talent and potential.

Reporting of the role - This role reports to the Director - Analytics,

3 best things about the job:

1. Responsible for data & analytics projects and developing data strategies by diving into data and extrapolating insights and providing guidance to clients

2. Build and be a part of a dynamic team

3. Being part of a global organisations with rapid growth opportunities

Responsibilities of the role:

 Build Marketing-Mix and Multi-Touch attribution models using a range of tools, including free and paid.

 Work with large data sets via hands-on data processing to produce structured data sets for analysis.

 Design and build Visualization, Dashboard and reports for both Internal and external clients using Tableau, Power BI, Datorama or R Shiny/Python.

What you will need:

 Degree in Mathematics, Statistics, Economics, Engineering, Data Science, Computer Science or quantitative field.

 2-3 years’ experience in Marketing/Data Analytics or related field with hands-on experience in building Marketing-Mix and Attribution models.  Proficiency in one or more coding languages – preferred languages: Python, R

 Proficiency in one or more Visualization Tools – Tableau, Datorama, Power BI

 Proficiency in using SQL.

 Proficiency with one or more statistical tools is a plus – Example: SPSS, SAS, MATLAB, Mathcad.

 Working experience using big data technologies (Hive/Hadoop) is a plus

Requirements

Experience

• 5+ years of professional experience in implementing MLOps framework to scale up ML in production.
• Hands-on experience with Kubernetes, Kubeflow, MLflow, Sagemaker, and other ML model experiment management tools including training, inference, and evaluation.
• Experience in ML model serving (TorchServe, TensorFlow Serving, NVIDIA Triton inference server, etc.)
• Proficiency with ML model training frameworks (PyTorch, Pytorch Lightning, Tensorflow, etc.).
• Experience with GPU computing to do data and model training parallelism.
• Solid software engineering skills in developing systems for production.
• Strong expertise in Python.
• Building end-to-end data systems as an ML Engineer, Platform Engineer, or equivalent.
• Experience working with cloud data processing technologies (S3, ECR, Lambda, AWS, Spark, Dask, ElasticSearch, Presto, SQL, etc.).
• Having Geospatial / Remote sensing experience is a plus.

Designation: Principal Data Engineer

Experience: Experienced

Position Type: Full Time Position

Location: Hyderabad

Office Timings: 9AM to 6PM

Compensation: As Per Industry standards

About Monarch:

At Monarch, we’re leading the digital transformation of farming. Monarch Tractor augments both muscle and mind with fully loaded hardware, software, and service machinery that will spur future generations of farming technologies. With our farmer-first mentality, we are building a smart tractor that will enhance (not replace) the existing farm ecosystem, alleviate labor availability, and cost issues, and provide an avenue for competitive organic and beyond farming by providing mechanical solutions to replace harmful chemical solutions. Despite all the cutting-edge technology we will incorporate, our tractor will still plow, till, and haul better than any other tractor in its class. We have all the necessary ingredients to develop, build and scale the Monarch Tractor and digitally transform farming around the world.

Description:

Monarch Tractor likes to invite an experience Python data engineer to lead our internal data engineering team in India. This is a unique opportunity to work on computer vision AI data pipelines for electric tractors. You will be dealing with data from a farm environment like videos, images, tractor logs, GPS coordinates and map polygons. You will be responsible for collecting data for research and development. For example, this includes setting up ETL data pipelines to extract data from tractors, loading these data into the cloud and recording AI training results.

This role includes, but not limited to, the following tasks:

● Lead data engineering team

● Own and contribute to more than 50% of the data engineering code base

● Scope out new project requirements

● Costing data pipeline solutions

● Create data engineering tooling

● Design custom data structures for efficient processing of data

Data engineering skills we are looking for:

● Able to work with large amounts of text log data, image data, and video data

● Fluently use AWS cloud solutions like S3, Lambda, and EC2

● Able to work with data from Robot Operating System

Required Experience:

● 3 to 5 years of experience using Python

● 3 to 5 years of experience using PostgreSQL

● 3 to 5 years of experience using AWS EC2, S3, Lambda

● 3 to 5 years of experience using Ubuntu OS or WSL

Good to have experience:

● Ray

● Robot Operating System

What you will get:

At Monarch Tractor, you’ll play a key role on a capable, dedicated, high-performing team of rock stars. Our compensation package includes a competitive salary, excellent health, dental and vision benefits, and company equity commensurate with the role you’ll play in our success. 

Responsibilities:

• Must be able to write quality code and build secure, highly available systems.
• Assemble large, complex datasets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing datadelivery, re-designing infrastructure for greater scalability, etc with the guidance.
• Create datatools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Monitoring performance and advising any necessary infrastructure changes.
• Defining dataretention policies.
• Implementing the ETL process and optimal data pipeline architecture
• Build analytics tools that utilize the datapipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Create design documents that describe the functionality, capacity, architecture, and process.
• Develop, test, and implement datasolutions based on finalized design documents.
• Work with dataand analytics experts to strive for greater functionality in our data
• Proactively identify potential production issues and recommend and implement solutions

Skillsets:

• Good understanding of optimal extraction, transformation, and loading of datafrom a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Proficient understanding of distributed computing principles
• Experience in working with batch processing/ real-time systems using various open-source technologies like NoSQL, Spark, Pig, Hive, Apache Airflow.
• Implemented complex projects dealing with the considerable datasize (PB).
• Optimization techniques (performance, scalability, monitoring, etc.)
• Experience with integration of datafrom multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, etc.,
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Creation of DAGs for dataengineering
• Expert at Python /Scala programming, especially for dataengineering/ ETL purposes

Job Details:-

Designation - Data Scientist

Urgently required. (NP of maximum 15 days)

Location:- Mumbai

Experience:- 5-7 years.

Package Offered:- Rs.5,00,000/- to Rs.9,00,000/- pa.

Data Scientist

Job Description:-

Responsibilities:

• Identify valuable data sources and automate collection processes
• Undertake preprocessing of structured and unstructured data
• Analyze large amounts of information to discover trends and patterns
• Build predictive models and machine-learning algorithms
• Combine models through ensemble modeling
• Present information using data visualization techniques
• Propose solutions and strategies to business challenges
• Collaborate with engineering and product development teams

Requirements:

• Proven experience as a Data Scientist or Data Analyst
• Experience in data mining
• Understanding of machine-learning and operations research
• Knowledge of R, SQL and Python; familiarity with Scala, Java is an asset
• Experience using business intelligence tools (e.g. Tableau) and data frameworks (e.g. Hadoop)
• Analytical mind and business acumen
• Strong math skills (e.g. statistics, algebra)
• Problem-solving aptitude
• Excellent communication and presentation skills
• BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Science or other quantitative field is preferred

Data Scientist

Requirements

● B.Tech/Masters in Mathematics, Statistics, Computer Science or another
quantitative field
● 2-3+ years of work experience in ML domain ( 2-5 years experience )
● Hands-on coding experience in Python
● Experience in machine learning techniques such as Regression, Classification,
Predictive modeling, Clustering, Deep Learning stack, NLP
● Working knowledge of Tensorflow/PyTorch

Optional Add-ons-

● Experience with distributed computing frameworks: Map/Reduce, Hadoop, Spark
etc.
● Experience with databases: MongoDB

JOB DESCRIPTION

• 2 to 6 years of experience in imparting technical training/ mentoring  
• Must have very strong concepts of Data Analytics
• Must have hands-on and training experience on Python, Advanced Python, R programming, SAS and machine learning
• Must have good knowledge of SQL and Advanced SQL
• Should have basic knowledge of Statistics
• Should be good in Operating systems GNU/Linux, Network fundamentals,        
• Must have knowledge on MS office (Excel/ Word/ PowerPoint)                           
• Self-Motivated and passionate about technology                                     
• Excellent analytical and logical skills and team player                               
• Must have exceptional Communication Skills/ Presentation Skills                         
• Good Aptitude skills is preferred                        
• Exceptional communication skills

Responsibilities:                                                                                         

• Ability to quickly learn any new technology and impart the same to other employees
• Ability to resolve all technical queries of students
• Conduct training sessions and drive the placement driven quality in the training
• Must be able to work independently without the supervision of a senior person
• Participate in reviews/ meetings                                                                                                          

Qualification:                                                                               

• UG: Any Graduate in IT/Computer Science, B.Tech/B.E. – IT/ Computers
• PG: MCA/MS/MSC – Computer Science
• Any Graduate/ Post graduate, provided they are certified in similar courses

ABOUT EDUBRIDGE

EduBridge is an Equal Opportunity employer and we believe in building a meritorious culture where everyone is recognized for their skills and contribution.

Launched in 2009 EduBridge Learning is a workforce development and skilling organization with 50+ training academies in 18 States pan India. The organization has been providing skilled manpower to corporates for over 10 years and is a leader in its space. We have trained over a lakh semi urban & economically underprivileged youth on relevant life skills and industry-specific skills and provided placements in over 500 companies. Our latest product E-ON is committed to complementing our training delivery with an Online training platform, enabling the students to learn anywhere and anytime.

To know more about EduBridge please visit: http://www.edubridgeindia.com/">http://www.edubridgeindia.com/

You can also visit us on https://www.facebook.com/Edubridgelearning/">Facebook , https://www.linkedin.com/company/edubridgelearning/">LinkedIn for our latest initiatives and products

About the Company:

 It is a Data as a Service company that helps businesses harness the power of data. Our technology fuels some of the most interesting big data projects of the word. We are a small bunch of people working towards shaping the imminent data-driven future by solving some of its fundamental and toughest challenges. 

Role: We are looking for an experienced team lead to drive data acquisition projects end to end. In this role, you will be working in the web scraping team with data engineers, helping them solve complex web problems and mentor them along the way. You’ll be adept at delivering large-scale web crawling projects, breaking down barriers for your team and planning at a higher level, and getting into the detail to make things happen when needed.  

Responsibilities  

•  Interface with clients and sales team to translate functional requirements into technical requirements 
•  Plan and estimate tasks with your team, in collaboration with the delivery managers 
•  Engineer complex data acquisition projects 
•  Guide and mentor your team of engineers 
•  Anticipate issues that might arise and proactively consider those into design 
•  Perform code reviews and suggest design changes 

Prerequisites 

•  Between 5-8 years of relevant experience 
• Fluent programming skills and well-versed with scripting languages like Python or Ruby 
• Solid foundation in data structures and algorithms 
• Excellent tech troubleshooting skills 
• Good understanding of web data landscape 
• Prior exposure to DOM, XPATH and hands on experience with selenium/automated testing is a plus 

Skills and competencies 

• Prior experience with team handling and people management is mandatory 
• Work independently with little to no supervision 
• Extremely high attention to detail  
•  Ability to juggle between multiple projects  

   3+ years of experience in deployment, monitoring, tuning, and administration of high concurrency MySQL production databases.

• Solid understanding of writing optimized SQL queries on MySQL databases
• Understanding of AWS, VPC, networking, security groups, IAM, and roles.
• Expertise in scripting in Python or Shell/Powershell
• Must have experience in large scale data migrations
• Excellent communication skills.