Add temprature, topk, topk and other input params to UI for llama2 gradio application on inf2/ray cluster

[harishvs]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

What is the outcome that you are trying to reach?

The UI for the gradio app does not accept inputs like temperature, topk, topk and other input params

right now the gradio app, hardcodes these input params.

Describe the solution you would like

By allowing users to modify these input params will make a better experience

Describe alternatives you have considered

none

Additional context