Task: Implement and Compare Luong (Multiplicative) and Bahdanau (Additive) Attention Mechanisms

Task: Implement and Compare Luong (Multiplicative) and Bahdanau (Additive) Attention Mechanisms: a task in Terminal-Lego-15k (Harbor dataset). Implement both Luong (multiplicative) attention and Bahdanau (additive) attention mechanisms from scratch using Python and NumPy. Then, create a comparison…

The task

Implement both Luong (multiplicative) attention and Bahdanau (additive) attention mechanisms from scratch using Python and NumPy. Then, create a comparison document that explains the key differences between the two approaches.

Part of PrimeIntellect/Terminal-Lego-15k.