基于角度感知Transformer的三维分子性质预测方法
3D Molecular Property Prediction Method Based on Angle-aware Transformer
-
摘要: 为解决传统三维Transformer分子性质预测方法忽视角度信息的关键问题,提出基于角度感知Transformer的三维分子性质预测方法。首先,该方法根据原子坐标计算键角、扭转角和旋转角,并采用球面贝塞尔函数和球谐函数将这些角度信息进行高维映射;然后,将计算得到的角度信息通过局部和全局图卷积层处理,生成可学习的角度感知位置编码,并将其作为偏置项融入Transformer中;最后,使用由2个带有SiLU激活函数的线性层和聚合函数组成的预测器来预测具体的三维分子性质。在量子化学和物理化学数据集上的实验结果表明,提出的方法与基线模型相比显著提升了预测精度。Abstract: To address a critical limitation of conventional 3D Transformer-based molecular property prediction methods that neglect angular information, a 3D molecular property prediction method based on Angle-aware Transformer. First, the method systematically calculated three fundamental angular descriptors from atomic coordinates: bond angles, torsional angles, and rotational angles. These angular features were subsequently transformed into high-dimensional embeddings through spherical Bessel functions and spherical harmonics. Second, the derived angular information was processed through local and global graph convolutional layers to generate learnable angle-aware positional encodings, which were then integrated into the Transformer architecture as bias terms. Finally, a predictor comprising two SiLUactivated linear layers with an aggregation function was designed for property-specific prediction. Comprehensive evaluations on benchmark quantum chemistry and physicochemical datasets demonstrate that this method achieves significant accuracy improvements over baselines.
下载: