Site icon PAT RESEARCH: B2B Reviews, Buying Guides & Best Practices

Mocha

Mocha is a Deep Learning framework for Julia, inspired by the C++ framework Caffe. Efficient implementations of general stochastic gradient solvers and common layers in Mocha could be used to train deep / shallow (convolutional) neural networks, with (optional) unsupervised pre-training via (stacked) auto-encoders.

Mocha has a clean architecture with isolated components like network layers, activation functions, solvers, regularizers, initializers, etc. Built-in components are sufficient for typical deep (convolutional) neural network applications and more are being added in each release. All of them could be easily extended by adding custom sub-types. Mocha is written in Julia, a high-level dynamic programming language designed for scientific computing. Combining with the expressive power of Julia and other its package eco-system, playing with deep neural networks in Mocha is easy and intuitive.

Mocha comes with multiple backend that could be switched transparently. The pure Julia backend is portable as it runs on any platform that supports Julia. This is reasonably fast on small models thanks to Julia's LLVM-based just-in-time (JIT) compiler and Performance Annotations, and could be very useful for prototyping.The native extension backend could be turned on when a C++ compiler is available.

It runs 2 to 3 times faster than the pure Julia backend.on the other hand, the GPU backend uses NVidia cuDNN, cuBLAS and customized CUDA kernels to provide highly efficient computation. It’s 20 to 30 times or even more speedup could be observed on a modern GPU device, especially on larger models.

Mocha uses the widely adopted HDF5 format to store both datasets and model snapshots, making it easy to inter-operate with Matlab, Python (numpy) and other existing computational tools. Mocha also provides tools to import trained model snapshots from Caffe. And since it is an Open Source program, users will be able to use it for freely and easily.

Exit mobile version