标题： DMTrack：通过双适配器的时空多模态跟踪 显示英文标题

标题： DMTrack: Spatio-Temporal Multimodal Tracking via Dual-Adapter

摘要： 在本文中，我们探索了适配器调优并引入了一种新颖的双适配器架构用于时空多模态跟踪，称为DMTrack。 我们的DMTrack的关键在于两个简单而有效的模块，包括一个时空模态适配器（STMA）和一个渐进式模态互补适配器（PMCA）模块。 前者单独应用于每种模态，旨在通过自提示调整从冻结主干中提取的时空特征，这在一定程度上可以弥合不同模态之间的差距，从而实现更好的跨模态融合。 后者旨在通过两个专门设计的像素级浅层和深层适配器逐步促进跨模态提示。 浅层适配器在两种模态之间使用共享参数，旨在弥合两种模态分支之间的信息流，从而为后续的模态融合奠定基础，而深层适配器则通过像素级的模态内注意力调节初步融合的信息流，并通过像素级的模态间注意力进一步生成模态感知提示。 通过这样的设计，DMTrack仅使用\textbf{0.93M}可训练参数即可实现有前途的时空多模态跟踪性能。 在五个基准上的大量实验表明，DMTrack取得了最先进结果。 代码将可用。 显示英文摘要

摘要： In this paper, we explore adapter tuning and introduce a novel dual-adapter architecture for spatio-temporal multimodal tracking, dubbed DMTrack. The key of our DMTrack lies in two simple yet effective modules, including a spatio-temporal modality adapter (STMA) and a progressive modality complementary adapter (PMCA) module. The former, applied to each modality alone, aims to adjust spatio-temporal features extracted from a frozen backbone by self-prompting, which to some extent can bridge the gap between different modalities and thus allows better cross-modality fusion. The latter seeks to facilitate cross-modality prompting progressively with two specially designed pixel-wise shallow and deep adapters. The shallow adapter employs shared parameters between the two modalities, aiming to bridge the information flow between the two modality branches, thereby laying the foundation for following modality fusion, while the deep adapter modulates the preliminarily fused information flow with pixel-wise inner-modal attention and further generates modality-aware prompts through pixel-wise inter-modal attention. With such designs, DMTrack achieves promising spatio-temporal multimodal tracking performance with merely \textbf{0.93M} trainable parameters. Extensive experiments on five benchmarks show that DMTrack achieves state-of-the-art results. Code will be available.