"fixed" sampling with old <eos> method

[lucidrains]

@sdtblck yet another try

[lucidrains]

@sdtblck if this still doesn't work, we'll give the non-cached version on the same branch a try

[lucidrains]

@sdtblck hmm, i don't see the logits mask being used at all, so it's likely going to be still broken with this old way of doing things

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 5 committers have signed the CLA.

❌ sid
❌ ConnorJL
❌ lucidrains
❌ leogao2
❌ kingoflolz

---

sid seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}