Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LOSS stuck arount 0.69 #114

Open
ashishjamarkattel opened this issue Jan 15, 2024 · 7 comments
Open

LOSS stuck arount 0.69 #114

ashishjamarkattel opened this issue Jan 15, 2024 · 7 comments

Comments

@ashishjamarkattel
Copy link

I got an strange issue while training color_sync net.
I have read your other issue for filtering the dataset. to [-1, 1 ] i really dont understand this. How do we do that.

  1. I have cut the video into less than 5sec.
  2. resolution of video is 760px to 1080px.
  3. Lr is 1e-4 also tried 1e-5
  4. batch size is 16.
@NochnoyRitzar
Copy link

NochnoyRitzar commented Jan 16, 2024

Hi!
[-1, 1] refers to are offset values between audio and video that you get after using code from https://github.com/joonson/syncnet_python on your videos.

I recommend running run_pipeline.py first, as it preprocesses video to make it suitable for syncnet, and then running run_syncnet.py from the same repo

@ashishjamarkattel
Copy link
Author

Thanks for the help. Is running those 2 command is enough ?

@NochnoyRitzar
Copy link

NochnoyRitzar commented Jan 16, 2024

Yes. There is another one which is run_visualize.py, but it's just for visualization purpose

@397688551
Copy link

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

@ashishjamarkattel
Copy link
Author

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

I am working on it. But i am not able to solve it still. Somewhere in case of mine syncnet_python not working for my avspeech dataset. Please let me know if you have solve it.

@drakitLiu
Copy link

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

I am working on it. But i am not able to solve it still. Somewhere in case of mine syncnet_python not working for my avspeech dataset. Please let me know if you have solve it.
I have encountered the same problem, which is also not falling at 0.69. oh my ! May I ask if you have solved it?

@drakitLiu
Copy link

I have encountered the same problem, which is also not falling at 0.69. May I ask if you have solved it?

I am working on it. But i am not able to solve it still. Somewhere in case of mine syncnet_python not working for my avspeech dataset. Please let me know if you have solve it.

Hi ! did you have solved it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants