Analysis of ffmpeg hardware accelerated playback framework

summary Ffmpeg provides API interfaces, and users can call these APIs to realize various functions of ffmpeg. To design the hardware decoding framework of video based on ffmpeg, we need to deeply understand the hardware decoding framework of ffmpeg. Therefore, this paper first analyzes the code framework of ffplay, starts with ffplay, goes dee ...

Posted by nivosh on Thu, 30 Jun 2022 21:54:01 +0300

Openvidu server builds kurento load balancing mechanism

Why extend the streaming media server (kurento) We pull down the code from the openvidu official website. After startup, the default is an openvidu server to a kurento server. Deal with signaling and streaming media respectively. According to the official document, under the condition that there are 7 sessions for one session and participants, ...

Posted by AcousticJames on Wed, 25 May 2022 08:07:39 +0300

Implementation of 1v1 audio and video chat room based on WebRTC

I preface WebRTC (Web real time communication) aims to introduce the real-time communication function into browsers. Users can carry out real-time communication between browsers without installing any other software or plug-ins. This paper introduces the realization of one-to-one audio and video real-time chat room function based on WebRTC. Th ...

Posted by fizzystutter on Sat, 21 May 2022 02:11:17 +0300

Audio and video development: M3U8 plays while caching

catalogue "Problem" of MP4 What is m3u8 Benefits of m3u8 Source code analysis Extended thinking: can mp4 cache fragments like m3u8? 1, "Problem" of MP4 1.1 moov affects the second opening rate after mdat Mp4 format is a Box, in which moov stores metadata information and mdat stores specific audio and video data info ...

Posted by ultrasound0000 on Sat, 16 Apr 2022 09:04:22 +0300

Audio and video development series (28)AudioTrack plays PCM audio

catalogue   AudioTrack and MediaPlayer Introduction to AudioTrack API (structure, operation, state machine) Specific implementation (Static and Stream modes) Problems encountered harvest 1, MediaPlayer and AudioTrack The Android audio player and the Mediatrack SDK provide three common audio playback API s AudioTrack manages and plays a ...

Posted by eugene2009 on Fri, 15 Apr 2022 11:58:54 +0300

Audio and video development: cache fragmentation to achieve data cache

catalogue What is cache sharding Why cache fragmentation How to achieve 1, What is cache sharding When we introduced Android videocache in the last article, we knew that it would download data until it was completely downloaded. This will lead to a waste of traffic. For example, a 5MB video has a bit rate of 2Mb/s and a total of 5Mx8/2=20 ...

Posted by brandon on Fri, 15 Apr 2022 11:18:52 +0300

How to customize RTCP information and use it in WebRTC

brief introductionThe author is currently working on an Android P2P video streaming project based on WebRTC. The existing demand is that the sender (Video Sender) stops transmitting video data to the Receiver after transmitting a certain number of frames to the Receiver (video Receiver). Since the sender cannot predict when the Receiver will re ...

Posted by lordgreg on Thu, 14 Apr 2022 08:43:41 +0300

Windows11+VS2019 download and compile WebRTC source code

preface 1. Currently, webrtc supports vs2017, vs2019 and vs2022 (vs2022 was downloaded and placed on disk D, but some compiled files in webrtc wrote the path of VS to death, so the vs2019 version was re downloaded and placed on the default path of Disk C to avoid some strange errors) 2. The whole process of downloading requires scientific Inte ...

Posted by irken on Fri, 08 Apr 2022 18:44:09 +0300

Koa2 builds a signaling server, and JS can also handle video calls!

Hello, I'm Yang Chenggong.The previous article introduced what WebRTC is and the steps of its communication process, and built a Demo of local communication. Finally, it talked about the idea of one to many implementation. The original address is: Audio and video communication plus meal -- a probe into WebRTCIn this article, when we introduce t ...

Posted by dr bung on Thu, 07 Apr 2022 09:02:11 +0300

Location of WebRTC source code analysis

The Location class is used to print the Location information of the object. The recorded information is mainly generated by class objects File name and location Function name and file Line number. Location usage example engineering Example project: https://pan.baidu.com/s/1rbI2hwXpMA-Pb-i-zCdVWA Extraction code: cenz Examples #incl ...

Posted by AtomicRax on Sat, 02 Apr 2022 21:16:40 +0300