You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
BUG: Buffer expansion causes position to exceed bounds, consider strategies
This issue can appear in transformer blocks
/app/models/llama/llama.py", line 260, in <module>
probs = llama.model(
/app/models/llama/transformer.py", line 83, in __call__
pos = variable("pos", 1, 1024).bind(start_pos)
/ext/tinygrad/tinygrad/shape/symbolic.py", line 155, in bind
assert self.val is none and self.min<=val<=self.max, f"cannot bind {val} to {self}"
shoutsid
changed the title
BUG: Buffer expansion causes postion to exceed bounds, consider strategies.
BUG: Buffer expansion causes position to exceed bounds, consider strategies.
Oct 22, 2023
BUG: Buffer expansion causes position to exceed bounds, consider strategies
This issue can appear in transformer blocks
townhall/app/models/llama/transformer_block.py
Lines 68 to 75 in 25fda45
The text was updated successfully, but these errors were encountered: