Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add high-level backend specific gradient based optimization procedures #129

Open
braun-steven opened this issue Mar 27, 2023 · 0 comments
Open
Labels
feature New feature or request
Milestone

Comments

@braun-steven
Copy link
Member

We want to provide high-level gradient-descent based optimization procedures. The idea is that a user constructs some model structure with parameters $\theta$, has a dataset $\mathcal{D}$ and can now maximize $p(\mathcal{D} | \theta)$ with any backend. An examplary method could look like the following:

def optimize(model, data, optimizer, epochs, batch_size, ...):
    ...

which then uses optimizer to maximize the data likelihood batch-wise for epochs number of epochs.

This is not supposed to be very flexible but should provide a user with a simplistic version to train a model in a specific backend. More advanced users will most likely write their own optimization procedure.

Since tensorly does not provide any dataset/optimizer system, this needs to be implemented in all supported backends.

@braun-steven braun-steven added the feature New feature or request label Mar 27, 2023
@braun-steven braun-steven added this to the Version 1.0.0 milestone Mar 27, 2023
@braun-steven braun-steven changed the title [dev] Add high-level backend specific optimization procedures Add high-level backend specific optimization procedures Dec 11, 2023
@braun-steven braun-steven changed the title Add high-level backend specific optimization procedures Add high-level backend specific gradient based optimization procedures Dec 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
Status: Next
Development

No branches or pull requests

1 participant