Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Three variants essentially the same model? #87

Open
linfeng-du opened this issue Jul 17, 2023 · 2 comments
Open

Three variants essentially the same model? #87

linfeng-du opened this issue Jul 17, 2023 · 2 comments

Comments

@linfeng-du
Copy link

Dear authors,

Since NLinear and DLinear only apply additional linear operations (subtract last and moving average) on top of Linear which does not include any non-linearity. We would get the same results if we're solving via OLS and may get slightly different results via GD since the optimization dynamics may be different due to different matrix compositions. But seems that it wouldn't be that different to serve as a valid inductive bias for the model (as also shown by the results). Please correct me if I'm wrong. Thanks.

@dkhonker
Copy link

“ We would get the same results if we're solving via OLS ”
Is there any code for this part?

@linfeng-du
Copy link
Author

You don't need any code to verify that. If you solve a linear system via OLS the result would be determinsitic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants