607635d2ce
* Adding feature to load_weights by name Squashed commit of the following: commit fd47e763855c34ed78d26ee441d83e0e63f08119 Author: Arel Cordero <arel@ditto.us.com> Date: Thu Aug 18 16:02:14 2016 +0000 typo commit d0b06c03080131c55ab4777064a196ff339ad7df Author: Arel Cordero <arel@ditto.us.com> Date: Thu Aug 18 15:52:35 2016 +0000 update documentation for "load_weights" commit 844cfc2e8c9c6f267799a22ed54ac4d75807c5ab Author: Arel Cordero <arel@ditto.us.com> Date: Thu Aug 18 02:42:10 2016 +0000 batch updating weights commit f361a70da4b40b961f1af9c8f1c3cd26273d0cad Author: Arel Cordero <arel@ditto.us.com> Date: Thu Aug 18 02:29:17 2016 +0000 removing pudb line commit 738de4c371503626b4c9dbae6428fb279b368a76 Author: Arel Cordero <arel@ditto.us.com> Date: Wed Aug 17 19:56:51 2016 +0000 adding unit tests for loading weights by name commit cb0971b3cfe62452ab445e4034098cab2be3031b Author: Arel Cordero <arel@ditto.us.com> Date: Tue Aug 16 23:45:32 2016 +0000 cleaning up code based on comments commit ef08fd2c9f5d3c65359cbdf5b090e08733a518de Author: Arel Cordero <arel@ditto.us.com> Date: Tue Aug 16 04:50:46 2016 +0000 debugging commit 0d74f0e997960886b1044c26001de6cd6ad90bb9 Author: Arel Cordero <arel@ditto.us.com> Date: Tue Aug 16 04:15:43 2016 +0000 optionally load model by name * changed random file names to use tempfile module * clean up documentation strings * clarifying documentation |
||
---|---|---|
docker | ||
docs | ||
examples | ||
keras | ||
tests | ||
.gitignore | ||
.travis.yml | ||
CONTRIBUTING.md | ||
ISSUE_TEMPLATE.md | ||
LICENSE | ||
pytest.ini | ||
README.md | ||
setup.cfg | ||
setup.py |
Keras: Deep Learning library for Theano and TensorFlow
You have just found Keras.
Keras is a minimalist, highly modular neural networks library, written in Python and capable of running on top of either TensorFlow or Theano. It was developed with a focus on enabling fast experimentation. Being able to go from idea to result with the least possible delay is key to doing good research.
Use Keras if you need a deep learning library that:
- allows for easy and fast prototyping (through total modularity, minimalism, and extensibility).
- supports both convolutional networks and recurrent networks, as well as combinations of the two.
- supports arbitrary connectivity schemes (including multi-input and multi-output training).
- runs seamlessly on CPU and GPU.
Read the documentation at Keras.io.
Keras is compatible with: Python 2.7-3.5.
Guiding principles
-
Modularity. A model is understood as a sequence or a graph of standalone, fully-configurable modules that can be plugged together with as little restrictions as possible. In particular, neural layers, cost functions, optimizers, initialization schemes, activation functions, regularization schemes are all standalone modules that you can combine to create new models.
-
Minimalism. Each module should be kept short and simple. Every piece of code should be transparent upon first reading. No black magic: it hurts iteration speed and ability to innovate.
-
Easy extensibility. New modules are dead simple to add (as new classes and functions), and existing modules provide ample examples. To be able to easily create new modules allows for total expressiveness, making Keras suitable for advanced research.
-
Work with Python. No separate models configuration files in a declarative format. Models are described in Python code, which is compact, easier to debug, and allows for ease of extensibility.
Getting started: 30 seconds to Keras
The core data structure of Keras is a model, a way to organize layers. The main type of model is the Sequential
model, a linear stack of layers. For more complex architectures, you should use the Keras functional API.
Here's the Sequential
model:
from keras.models import Sequential
model = Sequential()
Stacking layers is as easy as .add()
:
from keras.layers import Dense, Activation
model.add(Dense(output_dim=64, input_dim=100))
model.add(Activation("relu"))
model.add(Dense(output_dim=10))
model.add(Activation("softmax"))
Once your model looks good, configure its learning process with .compile()
:
model.compile(loss='categorical_crossentropy', optimizer='sgd', metrics=['accuracy'])
If you need to, you can further configure your optimizer. A core principle of Keras is to make things reasonably simple, while allowing the user to be fully in control when they need to (the ultimate control being the easy extensibility of the source code).
from keras.optimizers import SGD
model.compile(loss='categorical_crossentropy', optimizer=SGD(lr=0.01, momentum=0.9, nesterov=True))
You can now iterate on your training data in batches:
model.fit(X_train, Y_train, nb_epoch=5, batch_size=32)
Alternatively, you can feed batches to your model manually:
model.train_on_batch(X_batch, Y_batch)
Evaluate your performance in one line:
loss_and_metrics = model.evaluate(X_test, Y_test, batch_size=32)
Or generate predictions on new data:
classes = model.predict_classes(X_test, batch_size=32)
proba = model.predict_proba(X_test, batch_size=32)
Building a question answering system, an image classification model, a Neural Turing Machine, a word2vec embedder or any other model is just as fast. The ideas behind deep learning are simple, so why should their implementation be painful?
For a more in-depth tutorial about Keras, you can check out:
In the examples folder of the repository, you will find more advanced models: question-answering with memory networks, text generation with stacked LSTMs, etc.
Installation
Keras uses the following dependencies:
- numpy, scipy
- pyyaml
- HDF5 and h5py (optional, required if you use model saving/loading functions)
- Optional but recommended if you use CNNs: cuDNN.
When using the Theano backend:
- Theano
When using the TensorFlow backend:
- TensorFlow
To install Keras, cd
to the Keras folder and run the install command:
sudo python setup.py install
You can also install Keras from PyPI:
sudo pip install keras
Switching from Theano to TensorFlow
By default, Keras will use Theano as its tensor manipulation library. Follow these instructions to configure the Keras backend.
Support
You can ask questions and join the development discussion on the Keras Google group.
You can also post bug reports and feature requests in Github issues. Make sure to read our guidelines first.
Why this name, Keras?
Keras (κέρας) means horn in Greek. It is a reference to a literary image from ancient Greek and Latin literature, first found in the Odyssey, where dream spirits (Oneiroi, singular Oneiros) are divided between those who deceive men with false visions, who arrive to Earth through a gate of ivory, and those who announce a future that will come to pass, who arrive through a gate of horn. It's a play on the words κέρας (horn) / κραίνω (fulfill), and ἐλέφας (ivory) / ἐλεφαίρομαι (deceive).
Keras was initially developed as part of the research effort of project ONEIROS (Open-ended Neuro-Electronic Intelligent Robot Operating System).
"Oneiroi are beyond our unravelling --who can be sure what tale they tell? Not all that men look for comes to pass. Two gates there are that give passage to fleeting Oneiroi; one is made of horn, one of ivory. The Oneiroi that pass through sawn ivory are deceitful, bearing a message that will not be fulfilled; those that come out through polished horn have truth behind them, to be accomplished for men who see them." Homer, Odyssey 19. 562 ff (Shewring translation).