Discrepency of Attentions between old and new model for batch 1.

[Saisriram01]

In our analysis of the code we found that during task t, after the old model has been loaded and frozen, the attentions obtained from the old_model and new_model aren't the same upon passing same batch of data(the first batch to be specific).
Can you please explain why it is so?