cross-attention en · NOUN
Etymology
From cross- + attention.
Meanings
-
(qualifier:machine learning, uncountable) A form of attention (machine learning method) where two different input sequences are compared, i.e. the keys and queries differ.
The cross attention layer inside each transformer decoder block is in fact a multi-head cross attention layer […]
2024, Benoit Liquet, Sarat Moka, Yoni Nazarathy, Mathematical Engineering of Deep Learning, CRC Press, page 286:
Forms
| Spelling | Features | Labels | Source |
|---|---|---|---|
| cross attention | alternative | lexicographic |