Suggestion: Adding Loss functions of Machine Learning in maths folder

[GreatRSingh]

I would like to suggest adding Loss functions in this repo.

The loss function estimates how well a particular algorithm models the provided data.

Add Loss Functions to: machine_learning/loss_functions

Task List:

• Cross-Entropy
• Hinge loss
• Huber loss.
• MSE
• NLL
• MAE
• Marginal Ranking
• KL Divergence

[Navaneeth-Sharma]

Hi @GreatRSingh ,
Thanks for the suggestion. Just to give an update, Some of them already implemented in maths section. Please check that. I have taken this up to add as many functions as possible.

[GreatRSingh]

@Navaneeth-Sharma Can you put up a list of loss functions that you are going to implement and which you have already implemented?

[Navaneeth-Sharma]

Sorry @GreatRSingh ,
I think I miss read loss as activation functions. Loss functions aren't implemented. But have a plans to do that specially the basic ones like Cross Entropy, MSE, RMSE. You can take it up some of those, if you like to contribute.

[GreatRSingh]

@Navaneeth-Sharma ok I will do that.

[Navaneeth-Sharma]

Hi, Just an info so that we dont implement the same losses, I will try to take up these loss functions

• Cross-Entropy loss (bin class, multi class)
• Hinge loss
• Huber loss.
  Let me know if any of them are already taken @GreatRSingh

[GreatRSingh]

@Navaneeth-Sharma No none of them are already taken.

I will take up MSE, NLL, MAE, MarginRanking, KLDivergence.

[GreatRSingh]

@Navaneeth-Sharma @siriak I have added a list of Loss Functions in the description.
Keep Suggesting any other if needed.

[github-actions]

This issue has been automatically marked as abandoned because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GreatRSingh]

Working on adding Hinge Loss

[github-actions]

This issue has been automatically marked as abandoned because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[mobley-trent]

Are all these functions taken ?

[GreatRSingh]

No, you can start working on them.

…

On Fri, Jan 5, 2024, 12:21 AM Eddy Oyieko ***@***.***> wrote: Are all these functions taken ? — Reply to this email directly, view it on GitHub <#559 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ALY6WHSWG3XIZJPTNJ44IDLYM32Z5AVCNFSM6AAAAAA5ZIPZLCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNZXGU4TONZZGU> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[avats-dev]

Opened a PR to add KL divergence loss as a sub task of this issue. #656
Kindly review.

[TruongNhanNguyen]

I have opened a PR that implements Huber loss function, which is mentioned is this issue #697 🚀.
Let's take a look on this PR 🤗.