Loading...

{{notif_text}}

Why join channels?
Learn from peers
Discuss and share learning resources with the top professionals across the world
Open business or job opportunities
Earn reputation points to get consulting projects, attract talent or land jobs.
Accelerate your growth
Grow your network and get exclusive deals from our learning partners.
signup now
Ram TR asked a question
{{::getFormatedLocalTime("2017-09-28T07:23:33.571Z", {without_time: true})}}

Big Data and ML algorithms

Would like to know how and what technologies to be used to get distributed data from many servers that to be used in R or Python for ML algorithm.  Assume we have data files stored in distributed servers. How to get those "big" data into R or Python to get Machine Learning (ML) processed?

answer
submitting answer...
submit
No answers yet. Be the first one to answer!
2 answers
Dinesh Ladi Artificial Intelligence & Data Science ethusiast
{{::getFormatedLocalTime("2017-09-29T06:57:24.750Z", {without_time: true})}}
You can use Spark Machine Learning Library for building pipelines on your disturbed data. You can install Spark on your Hadoop distributed cluster and build ML pipelines. 
Loading comments...
Vamsi M Artificial Intelligence & Data Science excites me
{{::getFormatedLocalTime("2018-08-25T04:53:01.459Z", {without_time: true})}}
Spark can be used effectively.

Apache Storm as well. It helps that we can use use Python to write the scripts for the tools and they have their own share of ML libraries
Loading comments...
To view all answers to this question, join this channel
join this channel
Learn how Cutshort Channels work
We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.
Okay
Privacy policy
File upload not supportedAudio recording not supported
This browser does not support file upload. Please follow the instructions to upload your resume.This browser does not support audio recording. Please follow the instructions to record audio.
  1. Click on the 3 dots
  2. Click on "Copy link"
  3. Open Google Chrome (or any other browser) and enter the copied link in the URL bar
Done