Figure3

Figure 3. Convergence processes of network weights with different values of $$ n $$ (Example 1). AN: Action network; CN: critic network.