Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Guidelines for setting T and k in mixLSTM #1

Open
Simply-Adi opened this issue Sep 11, 2022 · 0 comments
Open

Guidelines for setting T and k in mixLSTM #1

Simply-Adi opened this issue Sep 11, 2022 · 0 comments

Comments

@Simply-Adi
Copy link

Hello, I came across your interesting paper highlighting the potential of mixLSTM in handling time-varying relationships. I was trying to examine how well mixLSTM handles a one-time shift in the following data:

x1 = np.random.normal(5,1,1000)
x2 = np.random.normal(2,5,1000)
y_base = 10+(3*x1[:600]*x1[:600])+(5*x2[:600])
y_shifted = 10+(6.2*x1[600:]*x1[600:])+(5*x2[600:])
y = np.concatenate((y_base,y_shifted))

For this (X,y), I was experimenting with:
args= {'d':2,'hidden_size':300,'output_size':1,'batch_size':32,'T':30 and above}
k is 2 by default.
I tried various values of the above parameters but the model was not able to detect the shift. Could you pls. suggest guidelines on setting T and k?

@Simply-Adi Simply-Adi changed the title Guideline for setting T in mixLSTM Guidelines for setting T and k in mixLSTM Sep 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant