自动微分的基本思想与实现
On Automatic Differentiation
-
摘要: 科学计算及其应用常常需要多变量函数的有关偏导数问题的计算,通常使用的计算方法是符号微分或差分近似.对于中大规模问题来说,使用符号微分方法,成本往往非常昂贵,有时甚至不可行,在计算函数的方向梯度时,利用差分方法虽然可以降低计算成本,但得到的是近似值,而且确定恰当的差分区间也很困难.自动微分技术能以较低的成本精确计算中大规模问题函数的导数,在科学计算、工程计算及其应用领域中有着广泛的应用.Abstract: Evaluation relevant to the partial derivatives of the multivariable functions is often done in scientific computation, usually by means of the symbolic differentiation or the divided difference. But for the middle and large scale problems, the computation cost by symbolic differentiation is very expensive. When the direction derivative is evaluated, the computation cost by divided difference can be reduced, but it is only one kind of aproximate computation. Moreover, it is very difficult to confirm the divided difference interval rightly. Automatic differentiation, by which the derivatives of the function can be evaluated both exactly and economically, is applied to the field of scientific and engineering computation extensively.