-
Notifications
You must be signed in to change notification settings - Fork 271
metaRTC8 Successfully Adapts to RTOS
metaRTC8 Successfully Adapts to RTOS: Ushering in a New Era of MCU/Embedded Real-Time Audio and Video
Summary: BK7258 + FreeRTOS + metaRTC H.264 full-function debugging successful, supporting 720p real-time encoding and WebRTC interoperability.
With the rapid development of the Internet of Things (IoT) and smart terminals, more and more devices are evolving from "functional devices" to "intelligent interactive terminals." In this process, real-time audio and video communication capabilities are gradually becoming a core competency. However, traditional real-time audio and video technologies (such as WebRTC) have long relied on operating systems like Linux, Android, and iOS, making them difficult to implement on resource-constrained MCUs and lightweight embedded devices.
In contrast, RTOS (Real-Time Operating System) offers the following significant advantages:
- Extremely Low Resource Usage: Suitable for MCU platforms with limited RAM/Flash.
- Strong Real-Time Performance: Predictable task scheduling, suitable for low-latency communication.
- Lower Power Consumption: Supports deep sleep and fast wake-up, suitable for battery-powered devices.
- Simple System Structure: Easier to tailor and customize.
However, the RTOS ecosystem has long lacked mature real-time audio and video solutions, becoming a major bottleneck restricting the upgrade of smart devices.
The successful adaptation of metaRTC8 on RTOS, which has been successfully debugged on the Broadcom BK7258 (PCMA/H264), represents a key breakthrough in this bottleneck, bringing real-time audio and video capabilities into the world of MCU / SoC / embedded devices for the first time.
In traditional architectures, the WebRTC technology stack is relatively large and relies on:
- A complete TCP/IP protocol stack
- Multi-threading and complex scheduling mechanisms
- High-performance codec capabilities
- Large memory space
Therefore, platforms running RTOS typically face the following issues:
- Difficult to Port (Relies on Linux system calls)
- Excessive Resource Consumption (Unacceptable memory/CPU usage)
- Limited Codec Capabilities (Especially video)
- Lack of Mature Commercial Solutions
This has forced RTOS devices to rely on "simplified communication solutions" (such as voice intercoms, MJPEG streaming, etc.) for a long time, unable to achieve true real-time audio and video interaction.
The launch of metaRTC8.0 has broken this situation, achieving complete and usable real-time audio and video capabilities on RTOS, and has completed the following verifications:
- ✅ Successfully runs on FreeRTOS
- ✅ Successfully adapted to the BK7258 (Broadcom Integration) platform
- ✅ Achieved PCMA/H264 real-time audio and video communication capabilities
1) Lightweight Architecture Reconstruction
- Tailoring and reconstructing the traditional WebRTC architecture.
- Removing redundant modules to adapt to the RTOS task model.
- Optimizing memory usage and thread models.
2) RTOS Network and Scheduling Adaptation
- Adapting to the RTOS TCP/IP protocol stack.
- Reconstructing the event-driven mechanism to adapt to task scheduling.
- Optimizing performance in weak network and low bandwidth environments.
3) Implementation of Audio and Video Capabilities
-
Audio Coding: PCMA (G.711)
- Low complexity, low latency.
- Suitable for MCU real-time processing.
-
Video Coding: H.264
- Efficient support on embedded SoCs.
- Balancing compression rate and performance.
4) Low Power Optimization Capabilities metaRTC on RTOS supports:
- Non-continuous power (battery-powered) scenarios.
- Device hibernation and fast wake-up.
- On-demand connection establishment (event-triggered communication).
This makes it very suitable for device forms that are "always online but not continuously powered."
The implementation of metaRTC8 on RTOS has greatly expanded the boundaries of real-time audio and video applications, offering significant value especially in the following scenarios:
- Smart Doorbells: Low-power standby + instant video calls.
- Portable Live Streaming Devices: Lightweight, low-latency streaming.
- AI Glasses: First-person perspective real-time video interaction.
- Smart Toys / Companion Devices: Remote interaction, voice and video communication.
- Smart Watches / Kids' Cameras: Video capabilities for miniaturized devices.
👉 Features: Low power consumption, small size, strong real-time performance.
- Real-time video interaction for robots.
- Remote visual control of IoT devices.
- Edge AI devices (combined with large models).
metaRTC provides these devices with:
- Real-time data transmission channels.
- Audio and video interaction interfaces.
- Connectivity capabilities with cloud AI.
👉 Promoting the integrated development of "Edge Intelligence + Real-time Interaction".
- Smart Cockpits: In-car audio and video communication.
- Remote Driving: Low-latency video backhaul.
- Vehicle-Cloud Collaboration: Real-time data interaction.
RTOS is widely used in automotive systems. The adaptation of metaRTC enables:
- Automotive systems to achieve real-time video without relying on Linux.
- Improved system stability and real-time performance.
The successful adaptation of metaRTC8 on RTOS is of milestone significance:
- It breaks the dependence of real-time audio and video on Linux/high-performance systems.
- It truly brings WebRTC capabilities into the field of MCU / embedded devices.
- It achieves the technological fusion of "Low Power Consumption + Real-time Audio and Video".
- It provides new foundational capabilities for industries such as AIoT, smart hardware, and automotive systems.
In the future, with the continuous growth in the number of RTOS devices, metaRTC is expected to become key infrastructure in the field of embedded real-time communication, accelerating the arrival of the era of "Everything Video, Everything Interactive".