[BOUNTY] Add Qwen1.5 0.5B

[JushBJJ]

This PR is with the help of @marty1885 and @JonathanALevine.
This is a draft PR for now until the model is fully functional on Tenstorrent hardware. #20

The following issues need to be addressed:

• Reduce time complexity of node replacment in PyTorch frontend tt-tvm#1
• Support triu function for tvm.relay.expr.Call Inputs tt-tvm#2
• No proper support for aten::triu OP inputs when inputs are CallNodes [Bug]  tt-tvm#3
• Decompose tril ops with dynamic diagonal argument tt-tvm#5
• Allow masked_fill to handle non-boolean/hot tensor masks tt-tvm#4

---

Qwen1.5 0.5B

TODO

Requirements Checklist

TODO

Contribution Guidelines Checklist

TODO

[JushBJJ]

With all these patches, we internally have Qwen1.5 0.5B working on a Grayskull e150 (thanks @JonathanALevine). We're waiting for @marty1885 to test all of this in his e75. Should we convert this out of a draft PR?

@nvukobratTT @milank94

[JushBJJ]

A lot of optimizations will need to be made to speed this model up, stay tuned. I gotta do my uni assignments which are due tonight 😭

[nvukobratTT]

Great work @JushBJJ @marty1885 @JonathanALevine! Let us know once you get silicon results out of E75 :)))

We're working out some internal checking, as soon as we finalize those on our side we're going to complete code reviews and start with PR approvals.

Once again great progress and thanks for hunting these bounties! :)))

[marty1885]

I think there's some problems with the e75 - I ran inference for an hour but it never finished. Hope this doesn't affect the bounty as it works on the e150. It feels more like a low level compilation bug.

NVM. IT WORKS!! Just it's so slow that running it with the default settings takes forever. I can get it finish in a reasonable time if I set max_length to something short. Like 2.