Commit Graph

4 Commits

Author SHA1 Message Date
Matt Watson
cc053ac309 Add layers.MultiHeadAttention (#169)
* Add layers.MultiHeadAttention

* Update build/compute_output_signature argument checks

We do not definitively know which arguments are tensor arguments
at any given invocation (e.g. arguments with a None value may be tensor
arguments).

So rather than check that the build signature matches perfectly with
tensor call arguments, we will check the build signature arguments match
with some call argument.
2023-05-16 18:22:42 -07:00
Matt Watson
ca0b77d345 Add additive attention layer (#142)
* Add additive attention layer

* address comments
2023-05-11 10:26:39 -07:00
Matt Watson
c2623e2e98 Add Attention layer (#122)
* Add keras_core.layers.Attention

* Address style comments

* Fix jax
2023-05-09 16:25:50 -07:00
Francois Chollet
cceabce3e3 Add layer init files 2023-05-03 11:12:40 -07:00