Support AV1 codec. #3656
Replies: 12 comments 7 replies
-
|
I just did some research and found this webpage Second update: Adobe is also one of the developers of AV1, so it is expected to accelerate the integration of AV1 into RTMP. Third update (never-ending): Apple has recently joined AOM, so Apple will follow up. |
Beta Was this translation helpful? Give feedback.
-
|
FFmpeg already supports AV1 |
Beta Was this translation helpful? Give feedback.
-
|
Yes, I've tried it and it feels okay, just a bit slow. P.S. The correct one is FFMPEG |
Beta Was this translation helpful? Give feedback.
-
|
It's possible, but need more discuss. |
Beta Was this translation helpful? Give feedback.
-
|
Adobe will support AV1, but RTMP may not be updated. You can consider bypassing this problem, such as:
TS is a more flexible encapsulation, supporting all kinds of codecs, but the drawback is that it is too complex. |
Beta Was this translation helpful? Give feedback.
-
|
Define CodecID for AV1 in FLV: srs/trunk/src/kernel/srs_kernel_codec.hpp Line 66 in 74154cd |
Beta Was this translation helpful? Give feedback.
-
|
SRS had AV1 support for WebRTC, see #2324 However, we have plan but not decided to support AV1 in live stream, because Chrome(might? seems? not sure) does not support AV1. After Chrome had HEVC support, for decoding by hardware, then we start to support HEVC and mpegts.js supports HEVC over HTTP-TS or HTTP-FLV. Another issue, MPEG-TS does not support AV1, only a draft right now. So seems need more time for hardware decoder and MPEG-TS/HLS to support AV1 for live stream. |
Beta Was this translation helpful? Give feedback.
-
|
Implementing Live AV1 Encoding |
Beta Was this translation helpful? Give feedback.
-
|
Update on 2023.07.18 Currently, RTMP has been upgraded to support HEVC and AV1, as seen in #3495 It is likely that FFmpeg and OBS will quickly support AV1 over RTMP or HTTP-FLV. However, for players like MSE that need to support AV1 over MP4, further research may be required. While WebRTC supports AV1, it is only available on Chrome, and it appears that Safari does not support it. |
Beta Was this translation helpful? Give feedback.
-
I've tried 6.0-d0 with OBS and XSplit Broadcaster that supports AV1 RTMP streaming but it ignored the video stream. Actually this PR added support for HEVC but not AV1, do you have any plan to implement it as well, shall I open an issue for it ? |
Beta Was this translation helpful? Give feedback.
-
|
obsproject/obs-studio#9331 (comment) OBS is gonna support AV1 for WHIP soon. |
Beta Was this translation helpful? Give feedback.
-
|
The support for AV1 in media players is not yet fully developed, and there are missing decoders. If only WebRTC supports it and MSE does not, the functionality will still be quite limited. Additionally, OBS WHIP does not yet support RTMP conversion, and it lacks SR (Sender Report), so it cannot perform timestamp synchronization. As a result, it is also unable to record on the server. The completeness of WHIP is not sufficient, but of course, we will continue to follow up on the progress of new technologies.
|
Beta Was this translation helpful? Give feedback.
-
|
The support for WHIP in OBS is still in its early stages, for instance, it lacks support for Stream Resumption (SR), which prevents the conversion of WHIP to RTMP. Additionally, is Media Source Extensions (MSE) still not supporting AV1? This determines whether live streaming playback can support it. If these fundamental capabilities are not yet supported, even if SRS supports AV1, it cannot be effectively utilized in a production environment, and the solution would require significant modifications. It is better to thoughtfully consider and prepare rather than hastily support an immature technology.
|
Beta Was this translation helpful? Give feedback.
-
|
mpegts.js supports the AV1 codec. The SRS (Simple Real-time Server) is capable of handling AV1 in RTMP (Real-Time Messaging Protocol) and converting RTMP to WebRTC (Real-Time Communications).
|
Beta Was this translation helpful? Give feedback.
-
|
Does mpegts.js now support AV1 live streaming? Does this require hardware decoding support from the device? Due to the numerous projects we are involved in, my focus is more on application-level players like video.js. I am quite familiar with the creator of mpegts.js, but I truly lack the time to follow up on the detailed progress. If mpegts.js has added support for AV1 live streaming, then SRS should seriously consider adopting the AV1 codec.
|
Beta Was this translation helpful? Give feedback.
-
|
The code in mpegts.js has been merged, but the author has not released a new version PR. It has been tested and is capable of playing AV1 format HTTP-FLV streams.
|
Beta Was this translation helpful? Give feedback.
-
|
AV1 over FLV (Enhanced RTMP) has been already supported in mpegts.js. |
Beta Was this translation helpful? Give feedback.
-
|
Thank you to the expert @xqq for pointing out that MSE has already supported AV1 encoding. Could you please confirm if the support for AV1 in MSE is subject to any platform restrictions? For instance, support for H.265 in WebRTC is only available on Apple OS. Is AV1 support in MSE available across all platforms, including Windows, Apple, and iPadOS? Is it correct to assume that only iOS Safari lacks support?
|
Beta Was this translation helpful? Give feedback.
-
|
Is this available? AV1
|
Beta Was this translation helpful? Give feedback.
-
Alright, the title is very grand, but I don't have much to say.
First, let's talk about Google, Netflix, Firefox, Microsoft and other big players leading the AOM AV1. This is to "defeat" the super unfriendly licensing fee of H265, using a new generation of video encoding developed based on Google's VP10 (which was abandoned and incorporated into AV1). It is completely open source and free. It can be expected that this will be the hottest alternative to H265. In my opinion, apart from RTMP, AV1+DASH/HLS is one of the best solutions for live streaming in the future. Of course, there is still room for improvement in terms of latency.
Next, let's talk about the H265 encoding with a big mouthful of blood. Everyone was looking forward to it before it came out, but when it came out, they were shocked by the licensing fees. The very complex licensing traps make it difficult for large, medium and small companies. In terms of performance, major professional media have written about it, so I won't go into detail. But it is certain that it has improved a lot compared to H264. Comparing it to AV1, it seems that AV1 is slightly better. In the future, there will definitely be many companies using H265, but its share will inevitably be swallowed up by AV1, even a large part of it.
Based on the two most popular options above, I am most optimistic about the prospects of AV1+DASH. First of all, AV1 is open source and free for commercial use, which avoids many licensing traps. Secondly, the use of DASH is more convenient, and multi-resolution/bitrate switching is very flexible and convenient. Moreover, there is no specific requirement for video encoding. Thirdly, RTMP is limited by Adobe's development progress, so far, H265 has been out for several years, and the official still does not support H265.
As for iOS, it's better to stick with HLS. Although DASH can be used, the official clearly doesn't want you to use it, so save some energy.
Welcome to add more!!
P.S. Please make sure to pay attention to AV1 and integrate it into SRS, ffmpeg should support it.
Reference:
http://media.pkusz.edu.cn/achievements/?p=138
https://www.jianshu.com/p/ad8544e2d3fd
Beta Was this translation helpful? Give feedback.
All reactions