4cfad5ae0f
- 全新ui - 全面优化websocket逻辑，提高数字人和ui连接的稳定性及资源开销 - 全面优化唤醒逻辑，提供稳定的普通唤醒模式和前置词唤醒模式 - 优化拾音质量，支持多声道麦克风拾音 - 优化自动播放服务器的对接机制，提供稳定和兼容旧版ue工程的对接模式 - 数字人接口输出机器人表情，以适应新fay ui及单片机的数字人表情输出 - 使用更高级的音频时长计算方式，可以更精准控制音频播放完成后的逻辑 - 修复点击关闭按钮会导致程序退出的bug - 修复没有麦克风的设备开启麦克风会出错的问题 - 为服务器主机地址提供配置项，以方便服务器部署
245 lines
9.9 KiB
HTML
245 lines
9.9 KiB
HTML
<!DOCTYPE html>
|
|
<html>
|
|
<!-- Created by GNU Texinfo 7.0.1, https://www.gnu.org/software/texinfo/ -->
|
|
<head>
|
|
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
|
|
<title>NUT</title>
|
|
|
|
<meta name="description" content="NUT">
|
|
<meta name="keywords" content="NUT">
|
|
<meta name="resource-type" content="document">
|
|
<meta name="distribution" content="global">
|
|
<meta name="Generator" content="makeinfo">
|
|
<meta name="viewport" content="width=device-width,initial-scale=1">
|
|
|
|
<link href="#SEC_Contents" rel="contents" title="Table of Contents">
|
|
<style type="text/css">
|
|
<!--
|
|
div.example {margin-left: 3.2em}
|
|
ul.toc-numbered-mark {list-style: none}
|
|
-->
|
|
</style>
|
|
|
|
|
|
</head>
|
|
|
|
<body lang="en">
|
|
|
|
|
|
|
|
<div class="top-level-extent" id="SEC_Top">
|
|
|
|
|
|
<div class="element-contents" id="SEC_Contents">
|
|
<h2 class="contents-heading">Table of Contents</h2>
|
|
|
|
<div class="contents">
|
|
|
|
<ul class="toc-numbered-mark">
|
|
<li><a id="toc-Description" href="#Description">1 Description</a></li>
|
|
<li><a id="toc-Modes" href="#Modes">2 Modes</a>
|
|
<ul class="toc-numbered-mark">
|
|
<li><a id="toc-BROADCAST" href="#BROADCAST">2.1 BROADCAST</a></li>
|
|
<li><a id="toc-PIPE" href="#PIPE">2.2 PIPE</a></li>
|
|
</ul></li>
|
|
<li><a id="toc-Container_002dspecific-codec-tags" href="#Container_002dspecific-codec-tags">3 Container-specific codec tags</a>
|
|
<ul class="toc-numbered-mark">
|
|
<li><a id="toc-Generic-raw-YUVA-formats" href="#Generic-raw-YUVA-formats">3.1 Generic raw YUVA formats</a></li>
|
|
<li><a id="toc-Raw-Audio" href="#Raw-Audio">3.2 Raw Audio</a></li>
|
|
<li><a id="toc-Subtitles" href="#Subtitles">3.3 Subtitles</a></li>
|
|
<li><a id="toc-Raw-Data" href="#Raw-Data">3.4 Raw Data</a></li>
|
|
<li><a id="toc-Codecs" href="#Codecs">3.5 Codecs</a></li>
|
|
</ul></li>
|
|
</ul>
|
|
</div>
|
|
</div>
|
|
<div class="chapter-level-extent" id="Description">
|
|
<h2 class="chapter">1 Description</h2>
|
|
<p>NUT is a low overhead generic container format. It stores audio, video,
|
|
subtitle and user-defined streams in a simple, yet efficient, way.
|
|
</p>
|
|
<p>It was created by a group of FFmpeg and MPlayer developers in 2003
|
|
and was finalized in 2008.
|
|
</p>
|
|
<p>The official nut specification is at svn://svn.mplayerhq.hu/nut
|
|
In case of any differences between this text and the official specification,
|
|
the official specification shall prevail.
|
|
</p>
|
|
</div>
|
|
<div class="chapter-level-extent" id="Modes">
|
|
<h2 class="chapter">2 Modes</h2>
|
|
<p>NUT has some variants signaled by using the flags field in its main header.
|
|
</p>
|
|
<table class="multitable">
|
|
<tbody><tr><td width="40%">BROADCAST</td><td width="40%">Extend the syncpoint to report the sender wallclock</td></tr>
|
|
<tr><td width="40%">PIPE</td><td width="40%">Omit completely the syncpoint</td></tr>
|
|
</tbody>
|
|
</table>
|
|
|
|
<ul class="mini-toc">
|
|
<li><a href="#BROADCAST" accesskey="1">BROADCAST</a></li>
|
|
<li><a href="#PIPE" accesskey="2">PIPE</a></li>
|
|
</ul>
|
|
<div class="section-level-extent" id="BROADCAST">
|
|
<h3 class="section">2.1 BROADCAST</h3>
|
|
|
|
<p>The BROADCAST variant provides a secondary time reference to facilitate
|
|
detecting endpoint latency and network delays.
|
|
It assumes all the endpoint clocks are synchronized.
|
|
To be used in real-time scenarios.
|
|
</p>
|
|
</div>
|
|
<div class="section-level-extent" id="PIPE">
|
|
<h3 class="section">2.2 PIPE</h3>
|
|
|
|
<p>The PIPE variant assumes NUT is used as non-seekable intermediate container,
|
|
by not using syncpoint removes unneeded overhead and reduces the overall
|
|
memory usage.
|
|
</p>
|
|
</div>
|
|
</div>
|
|
<div class="chapter-level-extent" id="Container_002dspecific-codec-tags">
|
|
<h2 class="chapter">3 Container-specific codec tags</h2>
|
|
|
|
<ul class="mini-toc">
|
|
<li><a href="#Generic-raw-YUVA-formats" accesskey="1">Generic raw YUVA formats</a></li>
|
|
<li><a href="#Raw-Audio" accesskey="2">Raw Audio</a></li>
|
|
<li><a href="#Subtitles" accesskey="3">Subtitles</a></li>
|
|
<li><a href="#Raw-Data" accesskey="4">Raw Data</a></li>
|
|
<li><a href="#Codecs" accesskey="5">Codecs</a></li>
|
|
</ul>
|
|
<div class="section-level-extent" id="Generic-raw-YUVA-formats">
|
|
<h3 class="section">3.1 Generic raw YUVA formats</h3>
|
|
|
|
<p>Since many exotic planar YUVA pixel formats are not considered by
|
|
the AVI/QuickTime FourCC lists, the following scheme is adopted for
|
|
representing them.
|
|
</p>
|
|
<p>The first two bytes can contain the values:
|
|
Y1 = only Y
|
|
Y2 = Y+A
|
|
Y3 = YUV
|
|
Y4 = YUVA
|
|
</p>
|
|
<p>The third byte represents the width and height chroma subsampling
|
|
values for the UV planes, that is the amount to shift the luma
|
|
width/height right to find the chroma width/height.
|
|
</p>
|
|
<p>The fourth byte is the number of bits used (8, 16, ...).
|
|
</p>
|
|
<p>If the order of bytes is inverted, that means that each component has
|
|
to be read big-endian.
|
|
</p>
|
|
</div>
|
|
<div class="section-level-extent" id="Raw-Audio">
|
|
<h3 class="section">3.2 Raw Audio</h3>
|
|
|
|
<table class="multitable">
|
|
<tbody><tr><td width="40%">ALAW</td><td width="40%">A-LAW</td></tr>
|
|
<tr><td width="40%">ULAW</td><td width="40%">MU-LAW</td></tr>
|
|
<tr><td width="40%">P<type><interleaving><bits></td><td width="40%">little-endian PCM</td></tr>
|
|
<tr><td width="40%"><bits><interleaving><type>P</td><td width="40%">big-endian PCM</td></tr>
|
|
</tbody>
|
|
</table>
|
|
|
|
<p><type> is S for signed integer, U for unsigned integer, F for IEEE float
|
|
<interleaving> is D for default, P is for planar.
|
|
<bits> is 8/16/24/32
|
|
</p>
|
|
<div class="example">
|
|
<pre class="example-preformatted">PFD[32] would for example be signed 32 bit little-endian IEEE float
|
|
</pre></div>
|
|
|
|
</div>
|
|
<div class="section-level-extent" id="Subtitles">
|
|
<h3 class="section">3.3 Subtitles</h3>
|
|
|
|
<table class="multitable">
|
|
<tbody><tr><td width="40%">UTF8</td><td width="40%">Raw UTF-8</td></tr>
|
|
<tr><td width="40%">SSA[0]</td><td width="40%">SubStation Alpha</td></tr>
|
|
<tr><td width="40%">DVDS</td><td width="40%">DVD subtitles</td></tr>
|
|
<tr><td width="40%">DVBS</td><td width="40%">DVB subtitles</td></tr>
|
|
</tbody>
|
|
</table>
|
|
|
|
</div>
|
|
<div class="section-level-extent" id="Raw-Data">
|
|
<h3 class="section">3.4 Raw Data</h3>
|
|
|
|
<table class="multitable">
|
|
<tbody><tr><td width="40%">UTF8</td><td width="40%">Raw UTF-8</td></tr>
|
|
</tbody>
|
|
</table>
|
|
|
|
</div>
|
|
<div class="section-level-extent" id="Codecs">
|
|
<h3 class="section">3.5 Codecs</h3>
|
|
|
|
<table class="multitable">
|
|
<tbody><tr><td width="40%">3IV1</td><td width="40%">non-compliant MPEG-4 generated by old 3ivx</td></tr>
|
|
<tr><td width="40%">ASV1</td><td width="40%">Asus Video</td></tr>
|
|
<tr><td width="40%">ASV2</td><td width="40%">Asus Video 2</td></tr>
|
|
<tr><td width="40%">CVID</td><td width="40%">Cinepak</td></tr>
|
|
<tr><td width="40%">CYUV</td><td width="40%">Creative YUV</td></tr>
|
|
<tr><td width="40%">DIVX</td><td width="40%">non-compliant MPEG-4 generated by old DivX</td></tr>
|
|
<tr><td width="40%">DUCK</td><td width="40%">Truemotion 1</td></tr>
|
|
<tr><td width="40%">FFV1</td><td width="40%">FFmpeg video 1</td></tr>
|
|
<tr><td width="40%">FFVH</td><td width="40%">FFmpeg Huffyuv</td></tr>
|
|
<tr><td width="40%">H261</td><td width="40%">ITU H.261</td></tr>
|
|
<tr><td width="40%">H262</td><td width="40%">ITU H.262</td></tr>
|
|
<tr><td width="40%">H263</td><td width="40%">ITU H.263</td></tr>
|
|
<tr><td width="40%">H264</td><td width="40%">ITU H.264</td></tr>
|
|
<tr><td width="40%">HFYU</td><td width="40%">Huffyuv</td></tr>
|
|
<tr><td width="40%">I263</td><td width="40%">Intel H.263</td></tr>
|
|
<tr><td width="40%">IV31</td><td width="40%">Indeo 3.1</td></tr>
|
|
<tr><td width="40%">IV32</td><td width="40%">Indeo 3.2</td></tr>
|
|
<tr><td width="40%">IV50</td><td width="40%">Indeo 5.0</td></tr>
|
|
<tr><td width="40%">LJPG</td><td width="40%">ITU JPEG (lossless)</td></tr>
|
|
<tr><td width="40%">MJLS</td><td width="40%">ITU JPEG-LS</td></tr>
|
|
<tr><td width="40%">MJPG</td><td width="40%">ITU JPEG</td></tr>
|
|
<tr><td width="40%">MPG4</td><td width="40%">MS MPEG-4v1 (not ISO MPEG-4)</td></tr>
|
|
<tr><td width="40%">MP42</td><td width="40%">MS MPEG-4v2</td></tr>
|
|
<tr><td width="40%">MP43</td><td width="40%">MS MPEG-4v3</td></tr>
|
|
<tr><td width="40%">MP4V</td><td width="40%">ISO MPEG-4 Part 2 Video (from old encoders)</td></tr>
|
|
<tr><td width="40%">mpg1</td><td width="40%">ISO MPEG-1 Video</td></tr>
|
|
<tr><td width="40%">mpg2</td><td width="40%">ISO MPEG-2 Video</td></tr>
|
|
<tr><td width="40%">MRLE</td><td width="40%">MS RLE</td></tr>
|
|
<tr><td width="40%">MSVC</td><td width="40%">MS Video 1</td></tr>
|
|
<tr><td width="40%">RT21</td><td width="40%">Indeo 2.1</td></tr>
|
|
<tr><td width="40%">RV10</td><td width="40%">RealVideo 1.0</td></tr>
|
|
<tr><td width="40%">RV20</td><td width="40%">RealVideo 2.0</td></tr>
|
|
<tr><td width="40%">RV30</td><td width="40%">RealVideo 3.0</td></tr>
|
|
<tr><td width="40%">RV40</td><td width="40%">RealVideo 4.0</td></tr>
|
|
<tr><td width="40%">SNOW</td><td width="40%">FFmpeg Snow</td></tr>
|
|
<tr><td width="40%">SVQ1</td><td width="40%">Sorenson Video 1</td></tr>
|
|
<tr><td width="40%">SVQ3</td><td width="40%">Sorenson Video 3</td></tr>
|
|
<tr><td width="40%">theo</td><td width="40%">Xiph Theora</td></tr>
|
|
<tr><td width="40%">TM20</td><td width="40%">Truemotion 2.0</td></tr>
|
|
<tr><td width="40%">UMP4</td><td width="40%">non-compliant MPEG-4 generated by UB Video MPEG-4</td></tr>
|
|
<tr><td width="40%">VCR1</td><td width="40%">ATI VCR1</td></tr>
|
|
<tr><td width="40%">VP30</td><td width="40%">VP 3.0</td></tr>
|
|
<tr><td width="40%">VP31</td><td width="40%">VP 3.1</td></tr>
|
|
<tr><td width="40%">VP50</td><td width="40%">VP 5.0</td></tr>
|
|
<tr><td width="40%">VP60</td><td width="40%">VP 6.0</td></tr>
|
|
<tr><td width="40%">VP61</td><td width="40%">VP 6.1</td></tr>
|
|
<tr><td width="40%">VP62</td><td width="40%">VP 6.2</td></tr>
|
|
<tr><td width="40%">VP70</td><td width="40%">VP 7.0</td></tr>
|
|
<tr><td width="40%">WMV1</td><td width="40%">MS WMV7</td></tr>
|
|
<tr><td width="40%">WMV2</td><td width="40%">MS WMV8</td></tr>
|
|
<tr><td width="40%">WMV3</td><td width="40%">MS WMV9</td></tr>
|
|
<tr><td width="40%">WV1F</td><td width="40%">non-compliant MPEG-4 generated by ?</td></tr>
|
|
<tr><td width="40%">WVC1</td><td width="40%">VC-1</td></tr>
|
|
<tr><td width="40%">XVID</td><td width="40%">non-compliant MPEG-4 generated by old Xvid</td></tr>
|
|
<tr><td width="40%">XVIX</td><td width="40%">non-compliant MPEG-4 generated by old Xvid with interlacing bug</td></tr>
|
|
</tbody>
|
|
</table>
|
|
|
|
</div>
|
|
</div>
|
|
</div>
|
|
|
|
|
|
|
|
</body>
|
|
</html>
|