基于特征选择和特征表示的垂直联邦知识迁移算法

    Vertical Federated Knowledge Transfer Algorithm Based on Feature Selection and Feature Representation

    • 摘要: 为了突破现有的知识迁移融合方案大多以水平联邦学习算法为基础的局限性并且提高训练精度, 充分挖掘医疗机构中海量患者数据价值, 让不同资源状况的医院均能从中受益, 该文提出一种垂直联邦知识转移框架, 利用基于信息增益的特征选择模块和基于幂迭代的知识蒸馏模块辅助完成垂直联邦知识转移, 不仅能提高本地样本学习性能, 使共享样本数量有限的医院受益, 还能保证知识转移过程独立, 让医疗资源稀缺的医院之间可以相互协作, 有效提升医疗服务质量。仿真结果表明, 与LOCAL法、FTL法、VFedTrans方法相比, 该文提出的算法可以将疾病预测精度提升约10%。

       

      Abstract: To overcome the limitations that most of the existing knowledge transfer and fusion schemes are based on the horizontal federated learning algorithm and improve the training accuracy, and to fully explore the value of the massive patient data in medical institutions so that hospitals with different resource situations can benefit from it, this paper proposes a new vertical federated knowledge transfer framework. By utilizing the feature selection module based on information gain and the knowledge distillation module based on power iteration to assist in the vertical federated knowledge transfer, this framework can not only enhance the local sample learning performance and benefit hospitals with limited shared samples, but also guarantee the independence of the knowledge transfer process, enabling hospitals with scarce medical resources to cooperate with each other and effectively raise the quality of medical services. Simulation results show that compared with the LOCAL method, FTL method and VFedTrans method, the algorithm proposed in this paper can increase the disease prediction accuracy by about 10%.

       

    /

    返回文章
    返回