[openstack-dev] [machine learning] Question: Why there is no serious project for machine learning ?

eran at itsonlyme.name eran at itsonlyme.name
Mon Jan 16 10:05:15 UTC 2017


> Not sure what you mean by serious.
>
> Maybe you could have a look at Meteos[1]. It is a young project but surely
> focuses on machine learning.
>
> [1]: https://wiki.openstack.org/wiki/Meteos
Another avenue is to use Storlets for either the learn or prediction  
phase where the data resides in Swift.
We are currently adding IPython integration [1] that makes it very  
easy to deploy and invoke Storlets from IPython (a data scientists  
beloved tool :-), plus [2] is an initial working towards leveraging  
Storlets for machine learning.

In few more words: Storlets [3] allow to run a serverless computation  
inside Swift nodes, where the computation is done inside a Docker  
container. This basically means that you can write a piece of code (in  
either Python or Java) upload that code to Swift (as if it was a data  
object) and then invoke the uploaded code (called storlet) on your  
data (much like AWS Lambda). The nice thing is that the Docker image  
where the storlet is executed can be tailored by the admin, and as to  
make sure it has, e.g. scikit-learn installed. With such a Docker  
image you can write a storlet that would use the sickit-learn  
algorithms on swift objects.


[1] https://review.openstack.org/#/c/416089/
[2] https://github.com/eranr/mlstorlets
[3] http://storlets.readthedocs.io/en/latest/




More information about the OpenStack-dev mailing list