基于对比学习的双分类器无监督域适配模型
Contrastive Learning-based Bi-classifier Unsupervised Domain Adaptation Model
-
摘要: 针对深度域适配问题中冗余信息导致模型性能不佳的问题, 提出基于对比学习的双分类器域适配模型. 该模型基于双分类器对抗理论, 首先, 将输入数据增强2次以获得2个视角的特征, 通过将不同视角的特征输入不同的分类器提高分类器的多样性; 其次, 将双分类器方法和对比学习思想结合, 使模型能够捕获数据的高层语义表征, 减少不同类特征的混淆程度; 最后, 通过设立标签分布对齐正则项引导边界样本正确分类. 实验结果表明, 双分类器间的对比损失能提取数据中的有效信息, 从而提升模型性能.Abstract: For deep domain adaptation issues, redundant information in feature representation causes poor model performance. A bi-classifier domain adaptation model was proposed based on contrastive learning. Based on the theory of bi-classifier learning, the input data twice was enhanced to obtain the features from two views, and the diversity of classifiers was improved by inputting features of different perspectives into different classifiers. At the same time, by closely combining the bi-classifier method and contrast learning, the model was able to capture high-level semantic representations of the data, and reduce the confusion degree between feature from different class. Finally, the samples were recognized by the proposed model at classification boundary correctly by aligning the label distribution. Experimental results verify that the contrastive loss between two classifiers can extract valid information from the data, thereby improving model performance.