Jan Ozer’s Post

Are you familiar with the basics of video codec technology? From video formats to frame formats, we provide a comprehensive analysis for you: - Video formats (MP4, AVI, MKV) are the "communication protocols" for video playback - Video streams are divided into encoded streams (H.264) and raw streams (YUV) - Frame formats have three sampling methods: YUV444, YUV422, and YUV420 - Software encoding (CPU) and hardware encoding (GPU) have their own pros and cons Want to learn more details about video codecs? Click to read our detailed article "Basic Knowledge of Video Codec Technology From Video Formats to Frame Formats" https://lnkd.in/eWVYAqFi #videocodec #videoformat #videotechnology

Hey all: How I spent the weekend while my wife was away. Cost cutting seems to be on everyone's mind; here are five ways to think about cutting bandwidth costs via various codec-related or encoding-related methods: - Deploy new codec - Deploy per title - Deploy capped CRF - Deploy different manifests for mobile - Use a higher-quality preset As I conclude, if you’re already doing most of these, congrats, you’re on top of your game. If not, hopefully, you’ve got some new ideas about how to reduce your bandwidth costs (and you see this before your boss does).

It’s been 3-plus years since the MPEG codec explosion that brought us VVC, LCEVC, and EVC. Rather than breathlessly trumpet every single-digit quality improvement or design win, I’ll quickly get you up-to-speed on quality, playability, and usage of the most commonly utilised video codecs and then explore new codec-related advancements in business and technology.

Speech Recognition Tip: Audio Transcoding on the Fly with FFmpeg ✨ FFmpeg is a powerful tool for audio transcoding. While I've been using it for audio file transcoding during offline ASR inference, I recently needed it for on-the-fly transcoding for a streaming ASR use case. Often, streaming ASR models require a specific codec, format, or sampling rate, which might not match the format of the audio being streamed from the source. The FFmpeg command format can be easily adapted for this purpose. I made a quick guide on how to use the command to transcode an incoming websocket stream to the appropriate format expected by the ASR model. This shows just how versatile and powerful FFmpeg is. It's amazing to think this open-source package is used in many commercial applications, like YouTube, and almost every media player (most of which are wrappers over FFmpeg). #FFmpeg #ASR #AudioTranscoding #SpeechRecognition #OpenSource

I am excited to share that our paper entitled "MEDUSA: A Dynamic Codec Switching Approach in HTTP Adaptive Streaming" (w/ Farzad Tashtarian, Hermann Hellwagner, Christian Timmerer) has been accepted for publication in the prestigious ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) journal (Q1, IF: 5.1). Trying to optimise multi-codec video streaming from a client perspective, we formulate the problem of selecting the appropriate codec for each user and video segment (on a per-segment basis in the outmost case), exploiting key metrics, such as the perceived segment quality (VMAF) and size. To tackle this problem, we develop an adaptive bitrate (ABR) plug-in approach called MEDUSA that can enhance the Quality of Experience (QoE) of the users by up to 42% according to the ITU-T P.1203 model (mode 0) and reduce the transmitted data volume by up to more than 40% achieving a QoE similar to state-of-the-art techniques, reducing the burden on streaming service providers for delivery costs. Acknowledgment: Christian Doppler Forschungsgesellschaft CDG #WissenschafftWert Additional information can be found here: https://lnkd.in/dyzTtKU4 #multicodec #streaming #abr

The Shure MV7 Plus offers new DSP features for even better performance

A journey through #video #codec evolution, from MPEG-1 to AV1 and beyond. 🚀 Do you know that it takes around 10 years on average for a new video codec to hit the market? Driven by just two major groups. #compression #multimedia #3D #innovation

Somewhat buried in all of Apple's WWDC announcements, there were some new features and changes for the HLS spec. Nice to see some initial CMCD support and signaling for Dolby Vision with AV1 were added. We gathered the details and some background info in this blog, let us know what you are most interested in. https://okt.to/GngytH

Network capacity is not yet limitless and ubiquitous for our needs. The global picture remains highly varied in terms of access to high-speed internet and mobile networks. Although investment in, and implementation of, new networks is intensifying, it is likely to be many years yet before fast and robust connectivity is achieved on a global level. Consequently, there is an ongoing need to adapt and process content in order to complement different network types, with the implication that different solutions will be employed for different scenarios.   The need for different networks depends very much on the use case: production, contribution, distribution or consumer delivery.   Video compression formats like JPEG 2000, JPEG XS - often deployed where content is originated, and emerging consumer delivery codecs like MPEG-I Part 3 H.266 (aka VVC)  can extend the network capacity to manage 4K UHD and 8K UHD streams over IP – all while keeping latency ultra-low and maintaining pristine video quality.   With cloud-based solutions growing rapidly in use for IP production and distribution, transport solutions will need to handle high-quality, low delay, multi-camera for high-end productions spanning sport, studio shows, live events, and more.   So, in the same way that conversations regarding future video delivery technologies are happening in the consumer delivery world, The technologies specified for demanding video productions may also need to happen. We will likely have to find new ways to handle a greater number of signals and evolve solutions to support less compression than today’s MPEG4/HEVC solutions. No single technology rarely serves all applications perfectly, so enhanced solutions may need to support a variety of video compression formats for ultimate flexibility including uncompressed, visually lossless as well as legacy MPEG4 and HEVC. https://lnkd.in/esinmCsr #codec #videocompression #jpegxs #nimbraedge #netinsight #cloudproduction #remoteproduction #videotransport #uhd

🎙️ Exciting Research Update! 🎙️ Thrilled to share our latest work on streaming Audio-Visual Active Speaker Detection system that delivers real-time performance with reduced latency and memory usage. We analyze the impact of past and future context for efficient audio visual models and illustrate that past context is more important for accurate detection making it a memory bound problem. Check out the details in our paper: An Efficient and Streaming Audio Visual Active Speaker Detection System. Thanks to Yanzi Jin, Mohammad Hossein Sekhavat, Maxwell Horton, Daniel Tormoen, Devang N.. #ArtificialIntelligence #MachineLearning #Multimodal #Apple