标题： MAVD：包含深度信息的第一个开放的大规模普通话音视频数据集 显示英文标题

标题： MAVD: The First Open Large-Scale Mandarin Audio-Visual Dataset with Depth Information

摘要： 语音视觉语音识别（AVSR）作为人机交互的重要组成部分，正日益受到研究人员的关注。 然而，现有的可用普通话音视频数据集有限，并且缺乏深度信息。 为了解决这个问题，本工作建立了MAVD，一个包含64名母语中文说话人发出的12,484个发音的新大规模普通话多模态语料库。 为了确保数据集涵盖多种现实场景，开发了一个清理和过滤原始文本材料的流程，以创建一个平衡的阅读材料。 特别是，在数据采集过程中，使用了微软最新数据采集设备Azure Kinect，除了传统的音频信号和RGB图像外，还捕获深度信息。 我们还提供了一个基线实验，可用于评估数据集的有效性。 数据集和代码将在https://github.com/SpringHuo/MAVD发布。 显示英文摘要

摘要： Audio-visual speech recognition (AVSR) gains increasing attention from researchers as an important part of human-computer interaction. However, the existing available Mandarin audio-visual datasets are limited and lack the depth information. To address this issue, this work establishes the MAVD, a new large-scale Mandarin multimodal corpus comprising 12,484 utterances spoken by 64 native Chinese speakers. To ensure the dataset covers diverse real-world scenarios, a pipeline for cleaning and filtering the raw text material has been developed to create a well-balanced reading material. In particular, the latest data acquisition device of Microsoft, Azure Kinect is used to capture depth information in addition to the traditional audio signals and RGB images during data acquisition. We also provide a baseline experiment, which could be used to evaluate the effectiveness of the dataset. The dataset and code will be released at https://github.com/SpringHuo/MAVD.