Task: Implement and Compare Soft Attention vs Hard Attention Mechanisms

Task: Implement and Compare Soft Attention vs Hard Attention Mechanisms: a task in Terminal-Lego-15k (Harbor dataset). In neural network architectures, attention mechanisms allow models to focus on specific parts of the input when producing an output. There are two main variants: