Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How unimodal.pickle was generated? #3

Open
AlexTo opened this issue Jan 26, 2020 · 1 comment
Open

How unimodal.pickle was generated? #3

AlexTo opened this issue Jan 26, 2020 · 1 comment

Comments

@AlexTo
Copy link

AlexTo commented Jan 26, 2020

Hi
May I know how unimodal.pickle was generated? Is there source code that produces this file?
How do I interpret the dimension of "audio_train", "video_train" and "text_train" ?
Thank you

@SanaRahmani
Copy link

Hi, you can do a trick, it seems like the first part of the model that generates unimodal pickle file is much like the same part in their previous paper "Context-Dependent Sentiment Analysis in User-Generated Videos" which is published here by the author:
https://github.com/soujanyaporia/multimodal-sentiment-analysis
so in the code above you preprocess data and then generate unimodal pickle file as the guide suggests you can use this file here in HFusion and by very few changes you can get it to run(dense layers are set to have 4 units while file generated throw my suggested way is expected to be 3)
at the end this is not ideal and might even get you poor results but its a point you can start....
my results in this way where about 5 percent lower than accuracy reported in the paper for the same dataset.
also why is accuracy this low even for their own pickle file provided, does anyone know what dataset this file is generated from?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants