Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Comparision to other video processing frameworks #129

Open
rooterkyberian opened this issue Jan 16, 2021 · 1 comment
Open

Comparision to other video processing frameworks #129

rooterkyberian opened this issue Jan 16, 2021 · 1 comment

Comments

@rooterkyberian
Copy link

rooterkyberian commented Jan 16, 2021

This is request for documentation on how does this framework compare to other (especially more popular) video processing frameworks. If project maintainers feel like its not needed then we can at very least use this issue to gather this information.

I'm starting a new project and I'm wondering which of video frameworks should I use.
Only comparison that I have found so far [redacted VF name]: A Framework for Building Visual Analysis Pipelines ... which is extra confusing since its mostly about "other" framework also called VideoFlow (seems unreleased, and I hope it never will be under this name ;) )

The recent has witnessed some visual analysis frameworks. Nvidia launches the DeepStream project in the early days for video analysis on GPU (Purandare, 2018).
It is oriented as well as optimized on GPU and TensorRT, regardless of the bustling heterogeneous hardware devices.
Besides, it is built on top of GStreamer (GSTREAMER, 1999), which primarily targets audio/video media editing rather than analysis, limiting its flexibility and extensibility.
The gst-video-analytics project (Intel, 2019) is also built on top of GStreamer(Deuermeyer & Andrey). Google proposed MediaPipe bybuilding graphs for arbitrary streaming data processing with a computation graph as well (Lugaresi
et al., 2019).
MediaPipe can be used to build prototypes to polished cross-platform applications
and measure performance.
Though it is flexible and extensible on calculators, real online visual analysis expects extension on more aspects, more efficiency optimization, and model security protection.
Compared to MediaPipe, [redacted VF name] features these advantages for better application in both academia and industry.
Another framework also named Videoflow (de Armas, 2019) is designed to facilitate easy and quick definition of computer vision stream processing pipelines.
However, it is just a prototype experimental platform, with limitations on extensibility, efficiency, and security.

that last 2 sentences are about this project - are they in anyway accurate?

When browsing for video processing framework and assessing its popularity I was using lists such as https://awesomeopensource.com/projects/video-processing .

@docete
Copy link

docete commented Jun 23, 2021

Frankly they are actually not far off the mark.
I tested this with a dummy flow([VideoUrlReader], [FrameIndexSplitter], [DummyWritter which drops the frame]) with 1080p H264 video stream and found it only support 15 fps.
I think the main reason is data copy between multiple python processes (frame size is 6220800 bytes).
Shared memory in python 3.8 may speedup the flow, but the results are inconclusive.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants