keras/keras_core
Neel Kovelamudi d9b92cafb5 Adds all remaining Keras optimizers (Adamax, Adafactor, Nadam, and Ftrl) (#80)
* Add golden correctness tests for Adam and SGD

* Fix dtype issues

* Sync with main (#56)

* Minor touch ups

* Fix a pretty major bug

* Format code

* Big rethink of Variable API

* Make build-by-run the default build(), leveraging new zero_history KerasTensor mode

* Minor fixes

* Format code

* Switch back to build-by-eager-run for simplicity

* Add raise upon build failure

* Work around JAX bug.

* Add a few more tests.

* Add saving tests

* Adds test suite for SGD and golden correctness tests for all optimizers (#40)

* Add golden correctness tests for Adam and SGD

* Fix dtype issues

* Add binary accuracy (#41)

* chore: adding binary accuracy

* chore: fix docstring

* Add tests for add_loss and activity regularization.

* Reformat code

* Add ActivityRegularization layer

* Fix JAX CI.

* Add Lambda Callback (#42)

* Add LambdaCallback

* Add Lambda Callback

* Add Lambda Callback

* Rename lambda_callback_test.py

* Add einsum (#43)

* Add einsum

* address comments

* Fix format line length (#45)

* Add Embedding layer

* Shorten lines

* Add .vscode to .gitignore (#46)

* rm vscode settings

* add .vscode to gitignore

* Set demo program backend (#48)

* Add tests for training arg resolution in Layer.

* Implement mixed precision.

* Replace backend.execute with backend.numpy.XXX (#50)

* Add cosine similarity loss and update l2_normalize from regularizers (#34)

* Begin cosine loss

* Add testing for cosine similarity

* Fix formatting

* Docstring standardization

* Formatting

* Create numerical_utils

* Fix issue with call context lingering.

* Add the EarlyStopping callback (#44)

* add earlystopping callback

* addressing comments

* address comments

* addressing comments

* remove unused imports

* re-enable imports checks (#51)

* Add nn.one_hot (#52)

* Add GaussianDropout layer.

* Add GaussianNoise layer

* Add Categorical Accuracy Metric (#47)

* chore: adding categorical accuracy metric

* chore: reformat docstrings

* chore: reformat

* chore: ndims with len

* refactor the docstring

* Fix typos

* Implement masking.

---------

Co-authored-by: Francois Chollet <francois.chollet@gmail.com>
Co-authored-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
Co-authored-by: Ramesh Sampath <1437573+sampathweb@users.noreply.github.com>
Co-authored-by: Chen Qian <chenmoney@google.com>
Co-authored-by: Haifeng Jin <5476582+haifeng-jin@users.noreply.github.com>
Co-authored-by: Gabriel Rasskin <43894452+grasskin@users.noreply.github.com>

* Adds rmsprop optimizer and tests

* Add AdamW optimizer and tests, minor formatting changes

* Implemented formatting fixes

* Adds clip norm and clip value tests to Adam

* Adds Adagrad and Adadelta optimizers

* Applies fixes to formatting and deletes unnecessary kwargs

* Adds Adamax and Adafactor and associated tests

* Adds Nadam and Ftrl optimizers and associated tests

---------

Co-authored-by: Francois Chollet <francois.chollet@gmail.com>
Co-authored-by: Aritra Roy Gosthipaty <aritra.born2fly@gmail.com>
Co-authored-by: Ramesh Sampath <1437573+sampathweb@users.noreply.github.com>
Co-authored-by: Chen Qian <chenmoney@google.com>
Co-authored-by: Haifeng Jin <5476582+haifeng-jin@users.noreply.github.com>
Co-authored-by: Gabriel Rasskin <43894452+grasskin@users.noreply.github.com>
2023-05-03 21:16:00 +00:00
..
activations Fix activations clip usage (#63) 2023-04-30 20:31:06 -05:00
backend Add max and average pooling layer (#66) 2023-05-02 15:17:59 -07:00
callbacks re-enable imports checks (#51) 2023-04-27 17:51:32 -07:00
constraints Add bulk of serialization logic. 2023-04-21 10:00:32 -07:00
datasets Increase saving testing 2023-04-30 19:11:15 -07:00
initializers Add orthogonal initializer 2023-05-02 09:00:30 -07:00
layers Add layer init files 2023-05-03 11:12:40 -07:00
losses Add log_cosh and huber loss (#67) 2023-05-02 12:55:04 -04:00
metrics Fix typos 2023-05-02 15:23:08 -07:00
mixed_precision Add centralized global state management and export more Keras utilities. 2023-04-29 19:15:11 -07:00
models Fix bug. 2023-04-28 15:10:53 -07:00
operations Add max and average pooling layer (#66) 2023-05-02 15:17:59 -07:00
optimizers Adds all remaining Keras optimizers (Adamax, Adafactor, Nadam, and Ftrl) (#80) 2023-05-03 21:16:00 +00:00
regularizers Add normalize() to numerical utils. 2023-04-29 15:08:38 -07:00
saving Increase saving testing 2023-04-30 19:11:15 -07:00
testing Add Embedding layer 2023-04-26 20:22:03 -07:00
trainers Add pandas dataframe input tests 2023-05-03 09:27:44 -07:00
utils Add datasets namespace. Replace boston_housing with california_housing. 2023-04-30 18:50:58 -07:00
__init__.py Add bulk of serialization logic. 2023-04-21 10:00:32 -07:00
api_export.py Added initial Adam tests 2023-04-24 22:07:56 +00:00