Transferable Incremental Heuristic Dynamic Programming With Wastewater Treatment Applications

A transferable incremental heuristic dynamic programming (TI-HDP) algorithm is proposed for the control problem of the dissolved oxygen (DO) mass concentration in the wastewater treatment system.Considering the characteristics of the wastewater treatment process, this algorithm improves the anti- interference ability and weakens the structural disparity with the incremental proportional-integral- derivative (PID) algorithm by improving the updating method of the control variable into the incremental form.Based on the data-driven idea and by utilizing the historical data generated under the action of the PID algorithm, the expert experience in the traditional control field is successfully integrated into the framework of the TI-HDP algorithm, which ensures the stability of the control strategy of the TI-HDP algorithm in the early stage.Simulation results show that the TI-HDP algorithm achieves a higher control accuracy for the DO mass concentration than the PID algorithm and the traditional HDP algorithm.