-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
FYI this isn't working very well with youtube at the moment #355
Comments
Hello, thanks for reaching. Microlink is using a headless browser under the hood. I think this is happening because we are sending too much traffic to YouTube and they shadow ban us for a while. It needs to be investigated, thanks for reporting, I will report back after a better understanding of what's happening. |
@fusir is it working better these days? We implemented changes 🙂 |
@Kikobeats I'm still seeing issues with this; it seems to pull video titles/descriptions sporadically. Otherwise, defaults back to – YouTube / Share your videos with friends, family, and the world |
@coffeewithdonut did you try is passing In that way it's going to ensure to use a headless browser: |
@Kikobeats Yes, I've had more success with prerender set to false for YouTube links because Google seems to intercept the headless browser requests. It also seems like there is a cache layer that prerender false fetches from, popular videos tend to work, or videos I've fetched previously, but new videos initially return responses as below. Here are some example responses Prerender false:
Prerender true:
|
@fusir @coffeewithdonut We're continuing effort to fix this, can you check now and feedback us if it's working better? |
Particularly it is doing a poor job of finding a reasonable title and doesn't have consistent results.
I have tried it both in NodeJS and on the demo page of the website and got the same kinds of bad titles back.
There a two main kinds of errant titles. One just returns "Youtube" when requesting for a specific video. The other just returns the pathname of url.
Example URL: https://www.youtube.com/watch?v=p24KbTBR3QE
Should result it: "POV: you return to office [outtakes]"
You can achieve the bug by running this code:
You can also see the same bug on the website here: https://microlink.io/meta
The bug is not consistent.
One possible solution would deviate from the headless browser as a service concept but you could in the case of youtube just use their API. That's what I'll be doing in the meantime.
The text was updated successfully, but these errors were encountered: