About the usage of depth in the class MambaTransformerblock, in model.py

[Liberatedwinner]

Dear @kyegomez,

First of all, excuse me for my awkward English.
In forward(), I think using zip implies depth == transformer_depth == mamba_depth.
Hence, instead of using transformer_depth and mamba_depth, how about to use depth?
Would you mind if considering this idea?

Thank you very much.

[github-actions]

Hello there, thank you for opening an Issue ! 🙏🏻 The team was notified and they will get back to you asap.

[github-actions]

Stale issue message